[ 377.944434] nova-scheduler[50911]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. [ 379.015512] nova-scheduler[50911]: INFO oslo_service.periodic_task [-] Skipping periodic task _discover_hosts_in_cells because its interval is negative [ 379.026319] nova-scheduler[50911]: DEBUG oslo_db.sqlalchemy.engines [None req-06318474-b480-489b-9660-58720e741160 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=50911) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 379.134116] nova-scheduler[50911]: DEBUG nova.scheduler.host_manager [None req-06318474-b480-489b-9660-58720e741160 None None] Found 1 cells: e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe {{(pid=50911) refresh_cells_caches /opt/stack/nova/nova/scheduler/host_manager.py:746}} [ 379.134116] nova-scheduler[50911]: DEBUG nova.scheduler.host_manager [None req-06318474-b480-489b-9660-58720e741160 None None] Found 0 disabled cells: {{(pid=50911) refresh_cells_caches /opt/stack/nova/nova/scheduler/host_manager.py:758}} [ 379.163584] nova-scheduler[50911]: DEBUG nova.scheduler.host_manager [None req-06318474-b480-489b-9660-58720e741160 None None] START:_async_init_instance_info {{(pid=50911) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:427}} [ 379.165332] nova-scheduler[50911]: DEBUG oslo_concurrency.lockutils [None req-4c71b461-0f9e-40b9-947a-aa1e34a13c1a None None] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=50911) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 379.165592] nova-scheduler[50911]: DEBUG oslo_concurrency.lockutils [None req-4c71b461-0f9e-40b9-947a-aa1e34a13c1a None None] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=50911) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 379.166943] nova-scheduler[50911]: DEBUG oslo_concurrency.lockutils [None req-4c71b461-0f9e-40b9-947a-aa1e34a13c1a None None] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=50911) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 379.172355] nova-scheduler[50911]: DEBUG oslo_db.sqlalchemy.engines [None req-4c71b461-0f9e-40b9-947a-aa1e34a13c1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=50911) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 379.180249] nova-scheduler[50911]: DEBUG nova.scheduler.host_manager [None req-4c71b461-0f9e-40b9-947a-aa1e34a13c1a None None] Total number of compute nodes: 0 {{(pid=50911) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:440}} [ 379.180487] nova-scheduler[50911]: DEBUG oslo_concurrency.lockutils [None req-4c71b461-0f9e-40b9-947a-aa1e34a13c1a None None] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=50911) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 379.180687] nova-scheduler[50911]: DEBUG oslo_concurrency.lockutils [None req-4c71b461-0f9e-40b9-947a-aa1e34a13c1a None None] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=50911) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 379.180847] nova-scheduler[50911]: DEBUG oslo_concurrency.lockutils [None req-4c71b461-0f9e-40b9-947a-aa1e34a13c1a None None] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=50911) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 379.232065] nova-scheduler[50911]: DEBUG nova.scheduler.host_manager [None req-4c71b461-0f9e-40b9-947a-aa1e34a13c1a None None] Adding 0 instances for hosts 10-20 {{(pid=50911) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:459}} [ 379.232314] nova-scheduler[50911]: DEBUG nova.scheduler.host_manager [None req-4c71b461-0f9e-40b9-947a-aa1e34a13c1a None None] END:_async_init_instance_info {{(pid=50911) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:470}} [ 379.242914] nova-scheduler[50911]: DEBUG nova.context [None req-06318474-b480-489b-9660-58720e741160 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe(cell1) {{(pid=50911) load_cells /opt/stack/nova/nova/context.py:464}} [ 379.243289] nova-scheduler[50911]: DEBUG oslo_concurrency.lockutils [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=50911) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 379.243487] nova-scheduler[50911]: DEBUG oslo_concurrency.lockutils [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=50911) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 379.244133] nova-scheduler[50911]: DEBUG oslo_concurrency.lockutils [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=50911) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 379.244474] nova-scheduler[50911]: DEBUG oslo_concurrency.lockutils [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=50911) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 379.244657] nova-scheduler[50911]: DEBUG oslo_concurrency.lockutils [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=50911) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 379.244808] nova-scheduler[50911]: DEBUG oslo_concurrency.lockutils [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=50911) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 379.252069] nova-scheduler[50911]: DEBUG oslo_db.sqlalchemy.engines [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=50911) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 379.257489] nova-scheduler[50911]: DEBUG oslo_concurrency.lockutils [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] Acquiring lock "singleton_lock" {{(pid=50911) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} [ 379.257665] nova-scheduler[50911]: DEBUG oslo_concurrency.lockutils [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] Acquired lock "singleton_lock" {{(pid=50911) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} [ 379.257897] nova-scheduler[50911]: DEBUG oslo_concurrency.lockutils [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] Releasing lock "singleton_lock" {{(pid=50911) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} [ 379.258128] nova-scheduler[50911]: INFO oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] Starting 2 workers [ 379.264092] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] Started child 51959 {{(pid=50911) _start_child /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:575}} [ 379.267704] nova-scheduler[51959]: INFO nova.service [-] Starting scheduler node (version 0.0.1) [ 379.268600] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] Started child 51961 {{(pid=50911) _start_child /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:575}} [ 379.269283] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] Full set of CONF: {{(pid=50911) wait /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:649}} [ 379.269506] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ******************************************************************************** {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} [ 379.269659] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] Configuration options gathered from: {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} [ 379.269840] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} [ 379.270586] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] config files: ['/etc/nova/nova.conf'] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} [ 379.270738] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ================================================================================ {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} [ 379.271152] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] allow_resize_to_same_host = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.271363] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] arq_binding_timeout = 300 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.271558] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] block_device_allocate_retries = 60 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.271781] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] block_device_allocate_retries_interval = 3 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.272030] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cert = self.pem {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.272395] nova-scheduler[51961]: INFO nova.service [-] Starting scheduler node (version 0.0.1) [ 379.272709] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] compute_driver = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.273045] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] compute_monitors = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.273117] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] config_dir = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.273322] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] config_drive_format = iso9660 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.273484] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] config_file = ['/etc/nova/nova.conf'] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.273714] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] config_source = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.273914] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] console_host = devstack {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.274131] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] control_exchange = nova {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.274327] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cpu_allocation_ratio = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.274489] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] daemon = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.274702] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] debug = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.274855] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] default_access_ip_network_name = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.275061] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] default_availability_zone = nova {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.275233] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] default_ephemeral_format = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.275780] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.275780] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] default_schedule_zone = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.275908] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] disk_allocation_ratio = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.276064] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] enable_new_services = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.276292] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] enabled_apis = ['osapi_compute'] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.276486] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] enabled_ssl_apis = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.276676] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] flat_injected = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.276899] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] force_config_drive = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.277075] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] force_raw_images = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.277285] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] graceful_shutdown_timeout = 5 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.277433] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] heal_instance_info_cache_interval = 60 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.277928] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] host = devstack {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.278079] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] initial_cpu_allocation_ratio = 4.0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.278265] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] initial_disk_allocation_ratio = 1.0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.278440] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] initial_ram_allocation_ratio = 1.0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.279018] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.279018] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] instance_build_timeout = 0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.279140] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] instance_delete_interval = 300 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.279234] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] instance_format = [instance: %(uuid)s] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.280077] nova-scheduler[51959]: DEBUG oslo_db.sqlalchemy.engines [None req-a6396cae-f636-4471-86c7-140f57093d2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51959) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 379.280134] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] instance_name_template = instance-%08x {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.280134] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] instance_usage_audit = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.280297] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] instance_usage_audit_period = month {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.280422] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.280596] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] instances_path = /opt/stack/data/nova/instances {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.280785] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] internal_service_availability_zone = internal {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.281255] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] key = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.281255] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] live_migration_retry_count = 30 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.281434] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] log_config_append = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.281570] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.281746] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] log_dir = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.281932] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] log_file = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.282071] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] log_options = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.282236] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] log_rotate_interval = 1 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.282441] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] log_rotate_interval_type = days {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.282627] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] log_rotation_type = none {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.282758] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.282885] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.283077] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.283225] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.283345] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.283543] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] long_rpc_timeout = 1800 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.286025] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] max_concurrent_builds = 10 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.286099] nova-scheduler[51961]: DEBUG oslo_db.sqlalchemy.engines [None req-8e3f3a07-8d76-4b3f-b887-063718e9be4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51961) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 379.286150] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] max_concurrent_live_migrations = 1 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.286150] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] max_concurrent_snapshots = 5 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.286150] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] max_local_block_devices = 3 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.286150] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] max_logfile_count = 30 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.286150] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] max_logfile_size_mb = 200 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.286150] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] maximum_instance_delete_attempts = 5 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.286150] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] metadata_listen = 0.0.0.0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.286353] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] metadata_listen_port = 8775 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.286353] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] metadata_workers = 2 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.286353] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] migrate_max_retries = -1 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.286353] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] mkisofs_cmd = genisoimage {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.286353] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] my_block_storage_ip = 10.180.1.21 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.286353] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] my_ip = 10.180.1.21 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.286522] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] network_allocate_retries = 0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.286608] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.286749] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] osapi_compute_listen = 0.0.0.0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.286916] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] osapi_compute_listen_port = 8774 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.287117] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] osapi_compute_unique_server_name_scope = {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.289049] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] osapi_compute_workers = 2 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.289049] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] password_length = 12 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.289049] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] periodic_enable = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.289049] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] periodic_fuzzy_delay = 60 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.289049] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] pointer_model = usbtablet {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.289049] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] preallocate_images = none {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.289049] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] publish_errors = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.289305] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] pybasedir = /opt/stack/nova {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.289305] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ram_allocation_ratio = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.289305] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] rate_limit_burst = 0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.289305] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] rate_limit_except_level = CRITICAL {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.289305] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] rate_limit_interval = 0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.289305] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] reboot_timeout = 0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.289500] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] reclaim_instance_interval = 0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.289535] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] record = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.289693] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] reimage_timeout_per_gb = 20 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.289844] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] report_interval = 10 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.289999] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] rescue_timeout = 0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.290162] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] reserved_host_cpus = 0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.290311] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] reserved_host_disk_mb = 0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.290550] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] reserved_host_memory_mb = 512 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.290731] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] reserved_huge_pages = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.290888] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] resize_confirm_window = 0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.291053] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] resize_fs_using_block_device = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.291207] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] resume_guests_state_on_host_boot = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.291893] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.291893] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] run_external_periodic_tasks = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.291893] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] running_deleted_instance_action = reap {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.291893] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] running_deleted_instance_poll_interval = 1800 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.292126] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] running_deleted_instance_timeout = 0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.292170] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] scheduler_instance_sync_interval = 120 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.292342] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] service_down_time = 60 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.292541] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] servicegroup_driver = db {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.292705] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] shelved_offload_time = 0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.292857] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] shelved_poll_interval = 3600 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.293029] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] shutdown_timeout = 0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.293206] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] source_is_ipv6 = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.293357] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ssl_only = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.293547] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] state_path = /opt/stack/data/nova {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.293700] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] sync_power_state_interval = 600 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.293854] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] sync_power_state_pool_size = 1000 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.294014] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] syslog_log_facility = LOG_USER {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.294177] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] tempdir = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.294332] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] timeout_nbd = 10 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.294488] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] transport_url = **** {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.294919] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] update_resources_interval = 0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.294919] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] use_cow_images = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.295049] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] use_eventlog = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.295185] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] use_journal = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.296145] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] use_json = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.296145] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] use_rootwrap_daemon = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.296145] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] use_stderr = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.296145] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] use_syslog = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.296145] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vcpu_pin_set = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.296145] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vif_plugging_is_fatal = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.296360] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vif_plugging_timeout = 300 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.296493] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] virt_mkfs = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.296650] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] volume_usage_poll_interval = 0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.296811] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] watch_log_file = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.297179] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] web = /usr/share/spice-html5 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 379.297255] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_concurrency.disable_process_locking = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.297916] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.297916] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api.auth_strategy = keystone {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.297916] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api.compute_link_prefix = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.298059] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.298232] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api.dhcp_domain = novalocal {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.298399] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api.enable_instance_password = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.298562] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api.glance_link_prefix = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.298725] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.298893] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.299064] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api.instance_list_per_project_cells = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.299244] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api.list_records_by_skipping_down_cells = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.299457] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api.local_metadata_per_cell = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.299656] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api.max_limit = 1000 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.300102] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api.metadata_cache_expiration = 15 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.300102] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api.neutron_default_tenant_id = default {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.300187] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api.use_forwarded_for = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.300355] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api.use_neutron_default_nets = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.300554] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.301414] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.301414] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.301414] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api.vendordata_dynamic_ssl_certfile = {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.301414] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api.vendordata_dynamic_targets = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.301414] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api.vendordata_jsonfile_path = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.301623] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api.vendordata_providers = ['StaticJSON'] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.302415] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.backend = dogpile.cache.memcached {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.302415] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.backend_argument = **** {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.302415] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.config_prefix = cache.oslo {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.302540] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.dead_timeout = 60.0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.302618] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.debug_cache_backend = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.303105] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.enable_retry_client = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.303105] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.enable_socket_keepalive = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.303105] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.enabled = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.303300] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.expiration_time = 600 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.303503] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.hashclient_retry_attempts = 2 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.303631] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.hashclient_retry_delay = 1.0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.303792] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.memcache_dead_retry = 300 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.303978] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.memcache_password = {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.304157] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.304317] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.304480] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.memcache_pool_maxsize = 10 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.304661] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.304818] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.memcache_sasl_enabled = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.304995] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.305196] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.memcache_socket_timeout = 1.0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.305369] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.memcache_username = {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.305540] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.proxies = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.305707] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.retry_attempts = 2 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.305872] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.retry_delay = 0.0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.306045] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.socket_keepalive_count = 1 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.306210] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.socket_keepalive_idle = 1 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.306369] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.socket_keepalive_interval = 1 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.306526] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.tls_allowed_ciphers = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.306682] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.tls_cafile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.306839] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.tls_certfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.307077] nova-scheduler[51961]: DEBUG nova.service [None req-8e3f3a07-8d76-4b3f-b887-063718e9be4f None None] Creating RPC server for service scheduler {{(pid=51961) start /opt/stack/nova/nova/service.py:182}} [ 379.307230] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.tls_enabled = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.307413] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cache.tls_keyfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.307633] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cinder.auth_section = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.307809] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cinder.auth_type = password {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.307969] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cinder.cafile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.308427] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cinder.catalog_info = volumev3::publicURL {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.308427] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cinder.certfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.308707] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cinder.collect_timing = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.308707] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cinder.cross_az_attach = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.309090] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cinder.debug = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.309090] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cinder.endpoint_template = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.309235] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cinder.http_retries = 3 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.309600] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cinder.insecure = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.309600] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cinder.keyfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.309756] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cinder.os_region_name = RegionOne {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.309923] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cinder.split_loggers = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.310283] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cinder.timeout = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.310283] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.312768] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] compute.cpu_dedicated_set = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.312768] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] compute.cpu_shared_set = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.312768] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] compute.image_type_exclude_list = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.312768] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.312768] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] compute.max_concurrent_disk_ops = 0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.312768] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] compute.max_disk_devices_to_attach = -1 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.312768] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.313037] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.313037] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] compute.resource_provider_association_refresh = 300 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.313037] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] compute.shutdown_retry_interval = 10 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.313037] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.313037] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] conductor.workers = 2 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.313037] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] console.allowed_origins = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.313194] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] console.ssl_ciphers = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.313461] nova-scheduler[51959]: DEBUG nova.service [None req-a6396cae-f636-4471-86c7-140f57093d2b None None] Creating RPC server for service scheduler {{(pid=51959) start /opt/stack/nova/nova/service.py:182}} [ 379.313632] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] console.ssl_minimum_version = default {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.313845] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] consoleauth.token_ttl = 600 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.314065] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cyborg.cafile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.314233] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cyborg.certfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.314400] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cyborg.collect_timing = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.314563] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cyborg.connect_retries = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.314741] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cyborg.connect_retry_delay = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.314901] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cyborg.endpoint_override = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.315072] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cyborg.insecure = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.315229] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cyborg.keyfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.315385] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cyborg.max_version = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.315565] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cyborg.min_version = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.315719] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cyborg.region_name = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.315874] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cyborg.service_name = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.316094] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cyborg.service_type = accelerator {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.316377] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cyborg.split_loggers = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.316377] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cyborg.status_code_retries = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.316622] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cyborg.status_code_retry_delay = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.316652] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cyborg.timeout = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.316818] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.316977] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] cyborg.version = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.317193] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] database.backend = sqlalchemy {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.317376] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] database.connection = **** {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.317547] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] database.connection_debug = 0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.317718] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] database.connection_parameters = {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.317882] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] database.connection_recycle_time = 3600 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.318074] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] database.connection_trace = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.318223] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] database.db_inc_retry_interval = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.318384] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] database.db_max_retries = 20 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.318579] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] database.db_max_retry_interval = 10 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.318725] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] database.db_retry_interval = 1 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.319261] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] database.max_overflow = 50 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.319261] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] database.max_pool_size = 5 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.319261] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] database.max_retries = 10 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.319374] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] database.mysql_enable_ndb = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.319554] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.319716] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] database.mysql_wsrep_sync_wait = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.319942] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] database.pool_timeout = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.320131] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] database.retry_interval = 10 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.320290] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] database.slave_connection = **** {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.320453] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] database.sqlite_synchronous = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.320660] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] database.use_db_reconnect = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.320847] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api_database.backend = sqlalchemy {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.321182] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api_database.connection = **** {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.321229] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api_database.connection_debug = 0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.321386] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api_database.connection_parameters = {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.321535] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api_database.connection_recycle_time = 3600 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.321704] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api_database.connection_trace = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.321907] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api_database.db_inc_retry_interval = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.322087] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api_database.db_max_retries = 20 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.322294] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api_database.db_max_retry_interval = 10 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.322411] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api_database.db_retry_interval = 1 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.322580] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api_database.max_overflow = 50 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.322738] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api_database.max_pool_size = 5 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.322903] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api_database.max_retries = 10 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.323075] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api_database.mysql_enable_ndb = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.323480] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.323480] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.323557] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api_database.pool_timeout = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.323701] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api_database.retry_interval = 10 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.323856] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api_database.slave_connection = **** {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.324043] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] api_database.sqlite_synchronous = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.324218] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] devices.enabled_mdev_types = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.324417] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.324968] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ephemeral_storage_encryption.enabled = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.324968] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.324968] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.api_servers = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.325197] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.cafile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.325279] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.certfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.325417] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.collect_timing = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.325561] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.connect_retries = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.325716] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.connect_retry_delay = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.325898] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.debug = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.326064] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.default_trusted_certificate_ids = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.326229] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.enable_certificate_validation = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.326386] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.enable_rbd_download = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.327100] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.endpoint_override = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.327100] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.insecure = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.327100] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.keyfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.327100] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.max_version = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.327281] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.min_version = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.327342] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.num_retries = 3 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.327510] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.rbd_ceph_conf = {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.327670] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.rbd_connect_timeout = 5 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.327838] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.rbd_pool = {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.328011] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.rbd_user = {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.328226] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.region_name = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.328386] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.service_name = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.328564] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.service_type = image {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.328738] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.split_loggers = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.328983] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.status_code_retries = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.329046] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.status_code_retry_delay = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.329818] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.timeout = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.329818] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.329818] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.verify_glance_signatures = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.329818] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] glance.version = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.329995] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] guestfs.debug = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.330070] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] hyperv.config_drive_cdrom = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.330236] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] hyperv.config_drive_inject_password = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.330754] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.330754] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] hyperv.enable_instance_metrics_collection = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.330754] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] hyperv.enable_remotefx = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.330898] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] hyperv.instances_path_share = {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.331592] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] hyperv.iscsi_initiator_list = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.331592] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] hyperv.limit_cpu_features = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.331592] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.331592] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.331749] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] hyperv.power_state_check_timeframe = 60 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.331908] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.332088] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.332248] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] hyperv.use_multipath_io = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.332502] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] hyperv.volume_attach_retry_count = 10 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.332562] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.332855] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] hyperv.vswitch_name = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.332855] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.333062] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] mks.enabled = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.334077] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.334077] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] image_cache.manager_interval = 2400 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.334077] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] image_cache.precache_concurrency = 1 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.334191] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] image_cache.remove_unused_base_images = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.334362] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.334541] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.334715] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] image_cache.subdirectory_name = _base {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.334912] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ironic.api_max_retries = 60 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.335089] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ironic.api_retry_interval = 2 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.335334] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ironic.auth_section = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.335446] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ironic.auth_type = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.335768] nova-scheduler[51961]: DEBUG nova.service [None req-8e3f3a07-8d76-4b3f-b887-063718e9be4f None None] Join ServiceGroup membership for this service scheduler {{(pid=51961) start /opt/stack/nova/nova/service.py:199}} [ 379.335922] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ironic.cafile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.336114] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ironic.certfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.336305] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-8e3f3a07-8d76-4b3f-b887-063718e9be4f None None] DB_Driver: join new ServiceGroup member devstack to the scheduler group, service = {{(pid=51961) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} [ 379.336447] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ironic.collect_timing = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.336646] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ironic.connect_retries = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.336826] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ironic.connect_retry_delay = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.336982] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ironic.endpoint_override = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.337151] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ironic.insecure = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.337301] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ironic.keyfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.337457] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ironic.max_version = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.337598] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ironic.min_version = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.337752] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ironic.partition_key = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.337916] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ironic.peer_list = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.338084] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ironic.region_name = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.338269] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ironic.serial_console_state_timeout = 10 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.338457] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ironic.service_name = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.338637] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ironic.service_type = baremetal {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.338797] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ironic.split_loggers = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.338972] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ironic.status_code_retries = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.339159] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ironic.status_code_retry_delay = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.339317] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ironic.timeout = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.339539] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.339708] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ironic.version = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.339910] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.340122] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] key_manager.fixed_key = **** {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.340338] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.340515] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] barbican.barbican_api_version = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.340688] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] barbican.barbican_endpoint = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.341059] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] barbican.barbican_endpoint_type = public {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.341059] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] barbican.barbican_region_name = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.341226] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] barbican.cafile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.341393] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] barbican.certfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.341531] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] barbican.collect_timing = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.341689] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] barbican.insecure = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.342672] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] barbican.keyfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.342740] nova-scheduler[51959]: DEBUG nova.service [None req-a6396cae-f636-4471-86c7-140f57093d2b None None] Join ServiceGroup membership for this service scheduler {{(pid=51959) start /opt/stack/nova/nova/service.py:199}} [ 379.342776] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] barbican.number_of_retries = 60 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.342776] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] barbican.retry_delay = 1 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.342883] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-a6396cae-f636-4471-86c7-140f57093d2b None None] DB_Driver: join new ServiceGroup member devstack to the scheduler group, service = {{(pid=51959) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} [ 379.342920] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] barbican.send_service_user_token = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.343044] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] barbican.split_loggers = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.343211] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] barbican.timeout = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.343370] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] barbican.verify_ssl = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.343527] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] barbican.verify_ssl_path = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.344365] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] barbican_service_user.auth_section = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.344365] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] barbican_service_user.auth_type = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.344365] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] barbican_service_user.cafile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.344365] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] barbican_service_user.certfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.344365] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] barbican_service_user.collect_timing = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.344531] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] barbican_service_user.insecure = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.344626] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] barbican_service_user.keyfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.344779] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] barbican_service_user.split_loggers = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.344934] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] barbican_service_user.timeout = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.345134] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vault.approle_role_id = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.345293] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vault.approle_secret_id = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.345449] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vault.cafile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.345604] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vault.certfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.345761] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vault.collect_timing = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.345919] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vault.insecure = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.346356] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vault.keyfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.346356] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vault.kv_mountpoint = secret {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.346476] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vault.kv_version = 2 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.346584] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vault.namespace = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.346739] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vault.root_token_id = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.346900] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vault.split_loggers = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.347064] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vault.ssl_ca_crt_file = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.347222] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vault.timeout = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.347380] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vault.use_ssl = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.347568] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.347763] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] keystone.cafile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.347939] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] keystone.certfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.348115] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] keystone.collect_timing = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.348292] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] keystone.connect_retries = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.348448] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] keystone.connect_retry_delay = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.348600] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] keystone.endpoint_override = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.348757] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] keystone.insecure = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.348908] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] keystone.keyfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.349074] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] keystone.max_version = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.349230] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] keystone.min_version = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.349384] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] keystone.region_name = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.349563] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] keystone.service_name = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.349732] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] keystone.service_type = identity {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.349889] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] keystone.split_loggers = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.350059] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] keystone.status_code_retries = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.350220] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] keystone.status_code_retry_delay = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.350378] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] keystone.timeout = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.350572] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.350741] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] keystone.version = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.350973] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.connection_uri = {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.351168] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.cpu_mode = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.351349] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.cpu_model_extra_flags = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.351515] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.cpu_models = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.351684] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.cpu_power_governor_high = performance {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.351879] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.cpu_power_governor_low = powersave {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.352079] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.cpu_power_management = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.352274] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.352455] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.device_detach_attempts = 8 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.352747] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.device_detach_timeout = 20 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.352806] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.disk_cachemodes = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.352921] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.disk_prefix = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.353277] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.enabled_perf_events = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.353277] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.file_backed_memory = 0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.353404] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.gid_maps = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.353583] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.hw_disk_discard = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.353736] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.hw_machine_type = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.353897] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.images_rbd_ceph_conf = {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.354070] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.354250] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.354417] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.images_rbd_glance_store_name = {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.354580] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.images_rbd_pool = rbd {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.354749] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.images_type = default {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.354904] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.images_volume_group = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.355093] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.inject_key = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.355259] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.inject_partition = -2 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.355416] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.inject_password = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.355593] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.iscsi_iface = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.355750] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.iser_use_multipath = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.355911] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.live_migration_bandwidth = 0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.356085] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.356247] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.live_migration_downtime = 500 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.356404] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.356562] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.356738] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.live_migration_inbound_addr = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.356904] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.357088] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.live_migration_permit_post_copy = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.357269] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.live_migration_scheme = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.357450] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.live_migration_timeout_action = abort {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.357619] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.live_migration_tunnelled = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.357782] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.live_migration_uri = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.357942] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.live_migration_with_native_tls = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.358115] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.max_queues = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.358277] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.358453] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.nfs_mount_options = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.358700] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.358865] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.359033] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.num_iser_scan_tries = 5 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.359194] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.num_memory_encrypted_guests = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.359354] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.359542] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.num_pcie_ports = 0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.359789] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.num_volume_scan_tries = 5 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.359873] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.pmem_namespaces = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.360152] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.quobyte_client_cfg = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.360276] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.361738] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.rbd_connect_timeout = 5 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.361738] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.361738] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.361738] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.rbd_secret_uuid = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.361738] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.rbd_user = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.361738] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.361738] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.remote_filesystem_transport = ssh {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.361982] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.rescue_image_id = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.361982] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.rescue_kernel_id = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.361982] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.rescue_ramdisk_id = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.361982] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.rng_dev_path = /dev/urandom {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.362164] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.rx_queue_size = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.362335] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.smbfs_mount_options = {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.362553] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.363252] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.snapshot_compression = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.363252] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.snapshot_image_format = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.363252] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.363252] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.sparse_logical_volumes = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.363431] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.swtpm_enabled = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.363621] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.swtpm_group = tss {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.364207] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.swtpm_user = tss {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.364207] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.sysinfo_serial = unique {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.364207] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.tx_queue_size = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.364460] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.uid_maps = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.364633] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.use_virtio_for_bridges = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.364670] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.virt_type = kvm {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.364817] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.volume_clear = zero {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.365019] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.volume_clear_size = 0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.365208] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.volume_use_multipath = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.365365] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.vzstorage_cache_path = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.365532] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.365706] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.vzstorage_mount_group = qemu {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.365864] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.vzstorage_mount_opts = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.366047] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.366279] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.366453] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.vzstorage_mount_user = stack {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.366652] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.366861] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.auth_section = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.367045] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.auth_type = password {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.367213] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.cafile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.367367] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.certfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.367525] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.collect_timing = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.367707] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.connect_retries = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.367863] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.connect_retry_delay = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.368070] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.default_floating_pool = public {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.368260] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.endpoint_override = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.368434] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.extension_sync_interval = 600 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.368597] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.http_retries = 3 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.368755] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.insecure = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.368911] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.keyfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.369078] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.max_version = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.369249] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.369427] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.min_version = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.369601] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.ovs_bridge = br-int {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.369794] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.physnets = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.369971] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.region_name = RegionOne {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.370157] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.service_metadata_proxy = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.370314] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.service_name = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.370503] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.service_type = network {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.371478] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.split_loggers = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.371478] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.status_code_retries = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.371478] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.status_code_retry_delay = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.371478] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.timeout = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.371478] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.371637] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] neutron.version = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.371664] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] notifications.bdms_in_notifications = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.371866] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] notifications.default_level = INFO {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.372064] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] notifications.notification_format = unversioned {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.372229] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] notifications.notify_on_state_change = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.372405] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.372586] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] pci.alias = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.372775] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] pci.device_spec = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.372971] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] pci.report_in_placement = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.373194] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.auth_section = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.373388] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.auth_type = password {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.374028] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.auth_url = http://10.180.1.21/identity {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.374028] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.cafile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.374028] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.certfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.374028] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.collect_timing = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.374202] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.connect_retries = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.374325] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.connect_retry_delay = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.374525] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.default_domain_id = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.374688] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.default_domain_name = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.374849] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.domain_id = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.375008] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.domain_name = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.375176] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.endpoint_override = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.375333] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.insecure = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.375486] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.keyfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.375640] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.max_version = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.375791] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.min_version = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.376010] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.password = **** {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.376310] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.project_domain_id = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.376374] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.project_domain_name = Default {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.376556] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.project_id = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.376727] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.project_name = service {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.376893] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.region_name = RegionOne {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.377056] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.service_name = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.377222] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.service_type = placement {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.377422] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.split_loggers = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.377542] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.status_code_retries = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.377740] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.status_code_retry_delay = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.377905] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.system_scope = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.378071] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.timeout = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.378231] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.trust_id = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.378384] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.user_domain_id = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.378547] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.user_domain_name = Default {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.378704] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.user_id = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.378876] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.username = placement {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.379061] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.379238] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] placement.version = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.379455] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] quota.cores = 20 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.379644] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] quota.count_usage_from_placement = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.379817] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.379985] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] quota.injected_file_content_bytes = 10240 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.380161] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] quota.injected_file_path_length = 255 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.380325] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] quota.injected_files = 5 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.380505] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] quota.instances = 10 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.380680] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] quota.key_pairs = 100 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.380877] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] quota.metadata_items = 128 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.381086] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] quota.ram = 51200 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.381256] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] quota.recheck_quota = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.381422] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] quota.server_group_members = 10 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.381587] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] quota.server_groups = 10 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.381752] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] rdp.enabled = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.382110] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.382289] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.382507] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.382717] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] scheduler.image_metadata_prefilter = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.382902] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.383096] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] scheduler.max_attempts = 3 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.383281] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] scheduler.max_placement_results = 1000 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.383447] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.383612] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] scheduler.query_placement_for_availability_zone = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.383774] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] scheduler.query_placement_for_image_type_support = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.383975] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.384219] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] scheduler.workers = 2 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.384418] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.384591] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.384787] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.384954] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.385129] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.385314] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.385493] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.385738] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.385910] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] filter_scheduler.host_subset_size = 1 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.386078] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.386264] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.386425] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] filter_scheduler.isolated_hosts = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.386582] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] filter_scheduler.isolated_images = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.386991] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.386991] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.387150] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] filter_scheduler.pci_in_placement = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.387525] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.387525] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.387642] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.387700] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.387939] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.388113] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.388276] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] filter_scheduler.track_instance_changes = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.388451] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.388648] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] metrics.required = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.388787] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] metrics.weight_multiplier = 1.0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.388988] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] metrics.weight_of_unavailable = -10000.0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.389163] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] metrics.weight_setting = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.389483] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.389658] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] serial_console.enabled = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.389839] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] serial_console.port_range = 10000:20000 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.390018] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.390260] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.390368] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] serial_console.serialproxy_port = 6083 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.390559] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] service_user.auth_section = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.390735] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] service_user.auth_type = password {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.390893] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] service_user.cafile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.391059] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] service_user.certfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.391227] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] service_user.collect_timing = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.391385] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] service_user.insecure = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.391540] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] service_user.keyfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.391734] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] service_user.send_service_user_token = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.391877] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] service_user.split_loggers = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.392045] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] service_user.timeout = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.392230] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] spice.agent_enabled = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.392400] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] spice.enabled = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.392738] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.392951] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] spice.html5proxy_host = 0.0.0.0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.393134] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] spice.html5proxy_port = 6082 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.393299] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] spice.image_compression = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.393454] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] spice.jpeg_compression = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.393607] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] spice.playback_compression = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.393772] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] spice.server_listen = 127.0.0.1 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.393967] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.394142] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] spice.streaming_mode = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.394298] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] spice.zlib_compression = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.394592] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] upgrade_levels.baseapi = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.394631] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] upgrade_levels.cert = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.394766] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] upgrade_levels.compute = auto {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.395093] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] upgrade_levels.conductor = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.395093] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] upgrade_levels.scheduler = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.395257] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vendordata_dynamic_auth.auth_section = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.395416] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vendordata_dynamic_auth.auth_type = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.395571] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vendordata_dynamic_auth.cafile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.395722] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vendordata_dynamic_auth.certfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.395876] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.396041] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vendordata_dynamic_auth.insecure = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.396198] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vendordata_dynamic_auth.keyfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.396354] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.396507] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vendordata_dynamic_auth.timeout = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.396721] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vmware.api_retry_count = 10 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.396878] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vmware.ca_file = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.397060] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vmware.cache_prefix = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.397218] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vmware.cluster_name = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.397381] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vmware.connection_pool_size = 10 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.397535] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vmware.console_delay_seconds = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.397693] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vmware.datastore_regex = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.397847] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vmware.host_ip = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.398013] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vmware.host_password = **** {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.398184] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vmware.host_port = 443 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.398339] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vmware.host_username = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.398494] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vmware.insecure = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.398652] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vmware.integration_bridge = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.398811] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vmware.maximum_objects = 100 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.398965] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vmware.pbm_default_policy = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.399133] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vmware.pbm_enabled = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.399311] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vmware.pbm_wsdl_location = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.399495] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.399659] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vmware.serial_port_proxy_uri = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.399810] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vmware.serial_port_service_uri = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.399970] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vmware.task_poll_interval = 0.5 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.400140] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vmware.use_linked_clone = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.400303] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vmware.vnc_keymap = en-us {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.400489] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vmware.vnc_port = 5900 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.400662] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vmware.vnc_port_total = 10000 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.400848] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vnc.auth_schemes = ['none'] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.401018] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vnc.enabled = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.401335] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.401518] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.401688] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vnc.novncproxy_port = 6080 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.401887] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vnc.server_listen = 127.0.0.1 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.402073] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.402236] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vnc.vencrypt_ca_certs = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.402391] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vnc.vencrypt_client_cert = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.402544] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] vnc.vencrypt_client_key = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.402752] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.402911] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] workarounds.disable_deep_image_inspection = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.403082] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.403245] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] workarounds.disable_group_policy_check_upcall = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.403400] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.403580] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] workarounds.disable_rootwrap = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.403737] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] workarounds.enable_numa_live_migration = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.403891] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.404061] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.404222] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.404458] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] workarounds.libvirt_disable_apic = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.404525] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.404692] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.404990] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.404990] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.405154] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.405305] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.405456] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.405607] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.405756] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.405950] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.406221] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.406337] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] wsgi.client_socket_timeout = 900 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.406499] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] wsgi.default_pool_size = 1000 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.406664] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] wsgi.keep_alive = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.406826] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] wsgi.max_header_line = 16384 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.407010] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] wsgi.secure_proxy_ssl_header = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.407178] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] wsgi.ssl_ca_file = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.407334] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] wsgi.ssl_cert_file = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.407489] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] wsgi.ssl_key_file = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.407656] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] wsgi.tcp_keepidle = 600 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.407829] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.408048] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] zvm.ca_file = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.408258] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] zvm.cloud_connector_url = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.408722] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.408722] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] zvm.reachable_timeout = 300 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.408853] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.409026] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.409197] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.409359] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.409546] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.409769] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_policy.enforce_new_defaults = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.409963] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_policy.enforce_scope = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.410150] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_policy.policy_default_rule = default {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.410349] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.410522] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_policy.policy_file = policy.yaml {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.410705] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.410862] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.411023] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.411179] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.411336] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.411535] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.411791] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.411932] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] profiler.connection_string = messaging:// {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.412116] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] profiler.enabled = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.412295] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] profiler.es_doc_type = notification {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.412471] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] profiler.es_scroll_size = 10000 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.412641] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] profiler.es_scroll_time = 2m {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.412799] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] profiler.filter_error_trace = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.412958] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] profiler.hmac_keys = SECRET_KEY {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.413133] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] profiler.sentinel_service_name = mymaster {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.413295] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] profiler.socket_timeout = 0.1 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.413449] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] profiler.trace_sqlalchemy = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.413623] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] remote_debug.host = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.413891] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] remote_debug.port = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.413957] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.414128] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.414288] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.414448] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.414629] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.414768] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.414929] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.415109] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.415271] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.415428] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.415597] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.415759] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.415920] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.416090] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.416252] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.416426] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.416583] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.416815] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.416905] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.417080] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.417237] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.417399] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.417555] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.417715] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.417879] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.418055] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.ssl = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.418226] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.418389] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.418544] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.418712] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.418882] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_rabbit.ssl_version = {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.419097] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.419265] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_notifications.retry = -1 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.419489] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.419673] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_messaging_notifications.transport_url = **** {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.419876] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_limit.auth_section = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.420047] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_limit.auth_type = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.420205] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_limit.cafile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.420357] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_limit.certfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.420516] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_limit.collect_timing = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.420670] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_limit.connect_retries = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.420823] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_limit.connect_retry_delay = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.420975] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_limit.endpoint_id = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.421145] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_limit.endpoint_override = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.421474] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_limit.insecure = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.421474] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_limit.keyfile = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.421603] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_limit.max_version = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.421832] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_limit.min_version = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.421952] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_limit.region_name = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.422120] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_limit.service_name = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.422279] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_limit.service_type = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.422437] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_limit.split_loggers = False {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.422591] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_limit.status_code_retries = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.422745] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_limit.status_code_retry_delay = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.422911] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_limit.timeout = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.423086] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_limit.valid_interfaces = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.423244] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_limit.version = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.423437] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_reports.file_event_handler = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.423605] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.423763] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] oslo_reports.log_dir = None {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 379.423888] nova-scheduler[50911]: DEBUG oslo_service.service [None req-d3793ce1-a13d-472b-adc2-e4543c6c5d92 None None] ******************************************************************************** {{(pid=50911) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} [ 512.222696] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Starting to schedule for instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 512.224078] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 512.224504] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 512.224504] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 512.225366] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 512.226523] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 512.614437] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 512.615134] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 512.616849] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 512.622914] nova-scheduler[51961]: DEBUG oslo_db.sqlalchemy.engines [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51961) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 512.640580] nova-scheduler[51961]: DEBUG oslo_db.sqlalchemy.engines [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Parent process 50911 forked (51961) with an open database connection, which is being discarded and recreated. {{(pid=51961) checkout /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:434}} [ 512.648781] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 512.649103] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 512.649338] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 512.652273] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 512.652273] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 512.653909] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:01:22Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=0) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 512.654615] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Update host state with aggregates: [Aggregate(created_at=2025-02-03T11:02:00Z,deleted=False,deleted_at=None,hosts=['cpu-1'],id=1,metadata={},name='tempest-test_aggregate-1352670559',updated_at=None,uuid=bfaaa950-bd18-4835-868d-4d2dde6a8928)] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 512.654862] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 512.655095] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Update host state with instances: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 512.655326] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 512.655797] nova-scheduler[51961]: DEBUG nova.filters [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 512.656306] nova-scheduler[51961]: DEBUG nova.filters [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 512.656467] nova-scheduler[51961]: DEBUG nova.filters [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 512.656830] nova-scheduler[51961]: DEBUG nova.filters [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 512.657118] nova-scheduler[51961]: DEBUG nova.filters [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 512.657713] nova-scheduler[51961]: DEBUG nova.filters [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 512.657713] nova-scheduler[51961]: DEBUG nova.filters [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 512.657912] nova-scheduler[51961]: DEBUG nova.filters [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 512.658765] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 512.658765] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1, weight: 0.0]] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 512.658765] nova-scheduler[51961]: DEBUG nova.scheduler.utils [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Attempting to claim resources in the placement API for instance 43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee {{(pid=51961) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 512.729769] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] [instance: 43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 {{(pid=51961) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 512.730464] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 512.730464] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 512.730604] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-3048873c-2770-4203-b51f-4df52d73f47e tempest-ServerDiagnosticsTest-107573575 tempest-ServerDiagnosticsTest-107573575-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 514.766447] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Starting to schedule for instances: ['db1dd823-8349-4f34-9a8e-ecec90bd105b'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 514.767206] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 514.767452] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 514.767591] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 514.767951] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 514.768268] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 514.838917] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 514.839295] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 514.840993] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 514.846656] nova-scheduler[51959]: DEBUG oslo_db.sqlalchemy.engines [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51959) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 514.861931] nova-scheduler[51959]: DEBUG oslo_db.sqlalchemy.engines [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Parent process 50911 forked (51959) with an open database connection, which is being discarded and recreated. {{(pid=51959) checkout /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:434}} [ 514.877545] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 514.877850] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 514.878104] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 514.881295] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 514.881816] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 514.883059] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='0',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_task_None='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:02:04Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=1) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 514.883672] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Update host state with aggregates: [Aggregate(created_at=2025-02-03T11:02:00Z,deleted=False,deleted_at=None,hosts=['cpu-1'],id=1,metadata={},name='tempest-test_aggregate-1352670559',updated_at=None,uuid=bfaaa950-bd18-4835-868d-4d2dde6a8928)] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 514.883935] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 514.884175] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 514.884407] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 514.884840] nova-scheduler[51959]: DEBUG nova.filters [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 514.885186] nova-scheduler[51959]: DEBUG nova.filters [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 514.885477] nova-scheduler[51959]: DEBUG nova.filters [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 514.885812] nova-scheduler[51959]: DEBUG nova.filters [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 514.886108] nova-scheduler[51959]: DEBUG nova.filters [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 514.886366] nova-scheduler[51959]: DEBUG nova.filters [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 514.886618] nova-scheduler[51959]: DEBUG nova.filters [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 514.886852] nova-scheduler[51959]: DEBUG nova.filters [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 514.887126] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 514.887454] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1, weight: 0.0]] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 514.887770] nova-scheduler[51959]: DEBUG nova.scheduler.utils [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Attempting to claim resources in the placement API for instance db1dd823-8349-4f34-9a8e-ecec90bd105b {{(pid=51959) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 514.945556] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] [instance: db1dd823-8349-4f34-9a8e-ecec90bd105b] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 {{(pid=51959) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 514.945938] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 514.946180] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 514.946402] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-deb37827-d8fc-4227-915c-1adfea93e03b tempest-ServerDiagnosticsNegativeTest-707153589 tempest-ServerDiagnosticsNegativeTest-707153589-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 515.414190] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Starting to schedule for instances: ['4e62d785-7c74-4d3a-9446-e690822d5386'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 515.416413] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 515.416413] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 515.416413] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 515.416413] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 515.416880] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 515.436557] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Starting to schedule for instances: ['ebc60b43-dc9e-4f3c-81c7-f65fe50be628'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 515.436785] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 515.437039] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 515.441765] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 515.441765] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 515.441953] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 515.491428] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 515.491833] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 515.492179] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 515.511859] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 515.511859] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 515.511859] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 515.520781] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 515.521047] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 515.521472] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='0',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_task_None='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:02:06Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=2) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 515.521841] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Update host state with aggregates: [Aggregate(created_at=2025-02-03T11:02:00Z,deleted=False,deleted_at=None,hosts=['cpu-1'],id=1,metadata={},name='tempest-test_aggregate-1352670559',updated_at=None,uuid=bfaaa950-bd18-4835-868d-4d2dde6a8928)] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 515.522032] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 515.522317] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 515.522670] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 515.522670] nova-scheduler[51961]: DEBUG nova.filters [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 515.523053] nova-scheduler[51961]: DEBUG nova.filters [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 515.523053] nova-scheduler[51961]: DEBUG nova.filters [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 515.523229] nova-scheduler[51961]: DEBUG nova.filters [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 515.523437] nova-scheduler[51961]: DEBUG nova.filters [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 515.523558] nova-scheduler[51961]: DEBUG nova.filters [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 515.523723] nova-scheduler[51961]: DEBUG nova.filters [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 515.523882] nova-scheduler[51961]: DEBUG nova.filters [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 515.529101] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 515.529423] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1, weight: 0.0]] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 515.529748] nova-scheduler[51961]: DEBUG nova.scheduler.utils [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Attempting to claim resources in the placement API for instance 4e62d785-7c74-4d3a-9446-e690822d5386 {{(pid=51961) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 515.534863] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 515.539861] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 515.540308] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 515.553123] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 515.553123] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 515.553256] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 515.558127] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 515.558365] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 515.558734] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='0',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_task_None='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:02:06Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=2) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 515.559111] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Update host state with aggregates: [Aggregate(created_at=2025-02-03T11:02:00Z,deleted=False,deleted_at=None,hosts=['cpu-1'],id=1,metadata={},name='tempest-test_aggregate-1352670559',updated_at=None,uuid=bfaaa950-bd18-4835-868d-4d2dde6a8928)] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 515.559313] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 515.559597] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 515.559685] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 515.559898] nova-scheduler[51959]: DEBUG nova.filters [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 515.560137] nova-scheduler[51959]: DEBUG nova.filters [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 515.560369] nova-scheduler[51959]: DEBUG nova.filters [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 515.560576] nova-scheduler[51959]: DEBUG nova.filters [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 515.560749] nova-scheduler[51959]: DEBUG nova.filters [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 515.560914] nova-scheduler[51959]: DEBUG nova.filters [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 515.561711] nova-scheduler[51959]: DEBUG nova.filters [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 515.561711] nova-scheduler[51959]: DEBUG nova.filters [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 515.561711] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 515.561850] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1, weight: 0.0]] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 515.562556] nova-scheduler[51959]: DEBUG nova.scheduler.utils [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Attempting to claim resources in the placement API for instance ebc60b43-dc9e-4f3c-81c7-f65fe50be628 {{(pid=51959) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 515.622953] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] [instance: ebc60b43-dc9e-4f3c-81c7-f65fe50be628] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 {{(pid=51959) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 515.623293] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 515.623822] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 515.623822] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-2113d3f9-d4fd-4954-b30d-2701ee0748c0 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 515.639377] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] [instance: 4e62d785-7c74-4d3a-9446-e690822d5386] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 {{(pid=51961) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 515.639639] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 515.639714] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 515.640077] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-adda8732-e35a-4a60-965c-1dba92160496 tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 517.872613] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Starting to schedule for instances: ['23984fc7-95de-43c3-a21e-894fab241dce'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 517.873039] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 517.873206] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 517.873411] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 517.873637] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 517.873828] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 517.935752] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 517.937619] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 517.938101] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 517.949580] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 517.950568] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 517.950568] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 517.955522] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 517.955522] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 517.955891] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='0',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_task_None='4',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:02:07Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=4) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 517.956261] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 517.956477] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 517.956675] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 517.956877] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 517.957236] nova-scheduler[51961]: DEBUG nova.filters [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 517.957487] nova-scheduler[51961]: DEBUG nova.filters [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 517.957829] nova-scheduler[51961]: DEBUG nova.filters [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 517.957978] nova-scheduler[51961]: DEBUG nova.filters [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 517.958492] nova-scheduler[51961]: DEBUG nova.filters [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 517.959397] nova-scheduler[51961]: DEBUG nova.filters [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 517.959397] nova-scheduler[51961]: DEBUG nova.filters [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 517.959397] nova-scheduler[51961]: DEBUG nova.filters [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 517.959397] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 517.960072] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1, weight: 0.0]] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 517.960072] nova-scheduler[51961]: DEBUG nova.scheduler.utils [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Attempting to claim resources in the placement API for instance 23984fc7-95de-43c3-a21e-894fab241dce {{(pid=51961) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 518.034873] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] [instance: 23984fc7-95de-43c3-a21e-894fab241dce] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 {{(pid=51961) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 518.035202] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 518.037116] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 518.037822] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-91fa722a-bd01-4d75-bbab-eda42ae56232 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.002s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 518.935894] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Starting to schedule for instances: ['a93c0169-490e-4cd2-b890-5e1d8aecae59'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 518.936231] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 518.936397] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 518.936578] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 518.936817] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 518.937057] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 519.000264] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 519.000588] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 519.000805] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 519.013855] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 519.014101] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 519.014294] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 519.016549] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 519.016757] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 519.017152] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='0',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_task_None='5',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:02:09Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=5) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 519.018660] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 519.018660] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 519.018660] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 519.018811] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 519.018811] nova-scheduler[51959]: DEBUG nova.filters [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 519.018811] nova-scheduler[51959]: DEBUG nova.filters [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 519.018811] nova-scheduler[51959]: DEBUG nova.filters [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 519.018933] nova-scheduler[51959]: DEBUG nova.filters [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 519.018997] nova-scheduler[51959]: DEBUG nova.filters [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 519.019182] nova-scheduler[51959]: DEBUG nova.filters [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 519.019353] nova-scheduler[51959]: DEBUG nova.filters [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 519.019617] nova-scheduler[51959]: DEBUG nova.filters [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 519.019915] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 519.019980] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 519.020155] nova-scheduler[51959]: DEBUG nova.scheduler.utils [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Attempting to claim resources in the placement API for instance a93c0169-490e-4cd2-b890-5e1d8aecae59 {{(pid=51959) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 519.093865] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] [instance: a93c0169-490e-4cd2-b890-5e1d8aecae59] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=51959) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 519.094191] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 519.094405] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 519.094613] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-9af18614-334f-48c8-a4ed-e0a7157bfe48 tempest-ServerShowV257Test-744124833 tempest-ServerShowV257Test-744124833-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 522.423118] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Starting to schedule for instances: ['ce718fc3-6f75-49b9-8543-c953646ce0d9'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 522.423656] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 522.423656] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 522.423788] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 522.424138] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 522.424390] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 522.496802] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 522.497030] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 522.497263] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 522.504897] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 522.505179] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 522.506770] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 522.510059] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 522.510059] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 522.510666] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='0',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='1',num_task_None='6',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:02:10Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=6) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 522.510666] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 522.510800] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 522.510800] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'a93c0169-490e-4cd2-b890-5e1d8aecae59'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 522.510800] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 522.511193] nova-scheduler[51961]: DEBUG nova.filters [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 522.511193] nova-scheduler[51961]: DEBUG nova.filters [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 522.511193] nova-scheduler[51961]: DEBUG nova.filters [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 522.511193] nova-scheduler[51961]: DEBUG nova.filters [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 522.511193] nova-scheduler[51961]: DEBUG nova.filters [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 522.511481] nova-scheduler[51961]: DEBUG nova.filters [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 522.511481] nova-scheduler[51961]: DEBUG nova.filters [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 522.511481] nova-scheduler[51961]: DEBUG nova.filters [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 522.511481] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 522.511669] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1, weight: 0.0]] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 522.511669] nova-scheduler[51961]: DEBUG nova.scheduler.utils [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Attempting to claim resources in the placement API for instance ce718fc3-6f75-49b9-8543-c953646ce0d9 {{(pid=51961) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 522.603408] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] [instance: ce718fc3-6f75-49b9-8543-c953646ce0d9] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 {{(pid=51961) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 522.604091] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 522.604091] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 522.604274] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-10258a28-7eca-45bc-b693-3fc602fe0a6a tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 528.730742] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Starting to schedule for instances: ['426f9016-4e69-4e46-87f6-a67f77da5dff'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 528.731135] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 528.731230] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 528.731423] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 528.731678] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 528.731882] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 528.779798] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 528.780190] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 528.780332] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 528.788670] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 528.792640] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 528.792640] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 528.793077] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 528.793160] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 528.793557] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='0',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_spawning='7',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:02:16Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=7) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 528.793939] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 528.794134] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 528.794356] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'a93c0169-490e-4cd2-b890-5e1d8aecae59', 'ce718fc3-6f75-49b9-8543-c953646ce0d9'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 528.794561] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 528.794897] nova-scheduler[51959]: DEBUG nova.filters [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 528.795330] nova-scheduler[51959]: DEBUG nova.filters [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 528.795330] nova-scheduler[51959]: DEBUG nova.filters [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 528.795516] nova-scheduler[51959]: DEBUG nova.filters [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 528.795697] nova-scheduler[51959]: DEBUG nova.filters [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 528.795864] nova-scheduler[51959]: DEBUG nova.filters [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 528.796041] nova-scheduler[51959]: DEBUG nova.filters [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 528.796210] nova-scheduler[51959]: DEBUG nova.filters [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 528.796369] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 528.796539] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1, weight: 0.0]] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 528.796717] nova-scheduler[51959]: DEBUG nova.scheduler.utils [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Attempting to claim resources in the placement API for instance 426f9016-4e69-4e46-87f6-a67f77da5dff {{(pid=51959) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 528.852404] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] [instance: 426f9016-4e69-4e46-87f6-a67f77da5dff] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 {{(pid=51959) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 528.852714] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 528.852934] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 528.853369] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-e4af0805-3bc9-43c0-99bd-4cdee44030ac tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 532.025974] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Starting to schedule for instances: ['ae25fbd0-3770-43fc-9850-cdb2065b5ce3'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 532.026621] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 532.026845] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 532.027819] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 532.027898] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 532.028188] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 532.146432] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 532.146432] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 532.146432] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 532.154380] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 532.154906] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 532.154906] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 532.157377] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 532.157631] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 532.158051] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='0',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='1',num_task_spawning='7',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:02:20Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=8) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 532.158575] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 532.158869] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 532.159067] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'a93c0169-490e-4cd2-b890-5e1d8aecae59', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 532.159249] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 532.159510] nova-scheduler[51961]: DEBUG nova.filters [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 532.159722] nova-scheduler[51961]: DEBUG nova.filters [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 532.159912] nova-scheduler[51961]: DEBUG nova.filters [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 532.160428] nova-scheduler[51961]: DEBUG nova.filters [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 532.160428] nova-scheduler[51961]: DEBUG nova.filters [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 532.160585] nova-scheduler[51961]: DEBUG nova.filters [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 532.160838] nova-scheduler[51961]: DEBUG nova.filters [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 532.160838] nova-scheduler[51961]: DEBUG nova.filters [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 532.161209] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 532.162189] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1, weight: 0.0]] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 532.162189] nova-scheduler[51961]: DEBUG nova.scheduler.utils [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Attempting to claim resources in the placement API for instance ae25fbd0-3770-43fc-9850-cdb2065b5ce3 {{(pid=51961) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 532.215890] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] [instance: ae25fbd0-3770-43fc-9850-cdb2065b5ce3] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 {{(pid=51961) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 532.216279] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 532.216498] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 532.216709] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0b0b8a8c-0d6c-41eb-8956-7b62ea0886f7 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 533.397242] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Starting to schedule for instances: ['27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 533.400861] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 533.401573] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 533.401719] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 533.401942] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 533.402149] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 533.452237] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 533.452988] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 533.452988] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 533.462850] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 533.463313] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 533.463508] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 533.466121] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 533.466354] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 533.466760] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194926,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1664,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=9,service_id=None,stats={failed_builds='0',io_workload='9',num_instances='9',num_os_type_None='9',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='2',num_task_spawning='7',num_vm_building='9'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:02:23Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=9) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 533.467080] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 533.467575] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 533.467575] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'a93c0169-490e-4cd2-b890-5e1d8aecae59', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 533.468333] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 533.468658] nova-scheduler[51959]: DEBUG nova.filters [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 533.468911] nova-scheduler[51959]: DEBUG nova.filters [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 533.469168] nova-scheduler[51959]: DEBUG nova.filters [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 533.470090] nova-scheduler[51959]: DEBUG nova.filters [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 533.470090] nova-scheduler[51959]: DEBUG nova.filters [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 533.470090] nova-scheduler[51959]: DEBUG nova.filters [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 533.470263] nova-scheduler[51959]: DEBUG nova.filters [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 533.470379] nova-scheduler[51959]: DEBUG nova.filters [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 533.471469] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 533.471469] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1, weight: 0.0]] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 533.471469] nova-scheduler[51959]: DEBUG nova.scheduler.utils [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Attempting to claim resources in the placement API for instance 27836d31-f379-4b4b-aed1-155f4a947779 {{(pid=51959) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 533.537019] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] [instance: 27836d31-f379-4b4b-aed1-155f4a947779] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 {{(pid=51959) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 533.537019] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 533.537019] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 533.537239] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 533.537239] nova-scheduler[51959]: DEBUG nova.filters [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 533.537239] nova-scheduler[51959]: DEBUG nova.filters [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 533.537239] nova-scheduler[51959]: DEBUG nova.filters [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 533.537239] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 533.537421] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 533.537421] nova-scheduler[51959]: DEBUG nova.scheduler.utils [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Attempting to claim resources in the placement API for instance ef011071-c0e1-44e0-9940-285f2f45da67 {{(pid=51959) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 533.591879] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] [instance: ef011071-c0e1-44e0-9940-285f2f45da67] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51959) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 533.591879] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 533.591879] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 533.592148] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 533.592148] nova-scheduler[51959]: DEBUG nova.filters [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 533.592148] nova-scheduler[51959]: DEBUG nova.filters [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 533.592148] nova-scheduler[51959]: DEBUG nova.filters [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 533.592273] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194670MB disk: 193536MB io_ops: 11 instances: 11, allocation_candidates: 1] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 533.592801] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-ed4c064e-096a-46b0-a8e3-7c60afd9ead5 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194670MB disk: 193536MB io_ops: 11 instances: 11, allocation_candidates: 1, weight: 0.0]] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 534.540415] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-3d6f2696-c02e-4d99-9225-f569a7878bde tempest-ServerActionsTestOtherB-856597999 tempest-ServerActionsTestOtherB-856597999-project-member] Starting to schedule for instances: ['6829148d-8c80-4cbd-b6db-ed1855d4174e'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 534.540760] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-3d6f2696-c02e-4d99-9225-f569a7878bde tempest-ServerActionsTestOtherB-856597999 tempest-ServerActionsTestOtherB-856597999-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 534.540926] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-3d6f2696-c02e-4d99-9225-f569a7878bde tempest-ServerActionsTestOtherB-856597999 tempest-ServerActionsTestOtherB-856597999-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 534.544909] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-3d6f2696-c02e-4d99-9225-f569a7878bde tempest-ServerActionsTestOtherB-856597999 tempest-ServerActionsTestOtherB-856597999-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 534.544909] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-3d6f2696-c02e-4d99-9225-f569a7878bde tempest-ServerActionsTestOtherB-856597999 tempest-ServerActionsTestOtherB-856597999-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 534.544909] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-3d6f2696-c02e-4d99-9225-f569a7878bde tempest-ServerActionsTestOtherB-856597999 tempest-ServerActionsTestOtherB-856597999-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 534.611119] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-3d6f2696-c02e-4d99-9225-f569a7878bde tempest-ServerActionsTestOtherB-856597999 tempest-ServerActionsTestOtherB-856597999-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 534.611367] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-3d6f2696-c02e-4d99-9225-f569a7878bde tempest-ServerActionsTestOtherB-856597999 tempest-ServerActionsTestOtherB-856597999-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 534.611552] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-3d6f2696-c02e-4d99-9225-f569a7878bde tempest-ServerActionsTestOtherB-856597999 tempest-ServerActionsTestOtherB-856597999-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 534.620356] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-3d6f2696-c02e-4d99-9225-f569a7878bde tempest-ServerActionsTestOtherB-856597999 tempest-ServerActionsTestOtherB-856597999-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 534.620557] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-3d6f2696-c02e-4d99-9225-f569a7878bde tempest-ServerActionsTestOtherB-856597999 tempest-ServerActionsTestOtherB-856597999-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 534.620765] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-3d6f2696-c02e-4d99-9225-f569a7878bde tempest-ServerActionsTestOtherB-856597999 tempest-ServerActionsTestOtherB-856597999-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 534.624259] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-3d6f2696-c02e-4d99-9225-f569a7878bde tempest-ServerActionsTestOtherB-856597999 tempest-ServerActionsTestOtherB-856597999-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 534.624439] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-3d6f2696-c02e-4d99-9225-f569a7878bde tempest-ServerActionsTestOtherB-856597999 tempest-ServerActionsTestOtherB-856597999-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 534.624823] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-3d6f2696-c02e-4d99-9225-f569a7878bde tempest-ServerActionsTestOtherB-856597999 tempest-ServerActionsTestOtherB-856597999-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='1',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:02:25Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 534.625128] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-3d6f2696-c02e-4d99-9225-f569a7878bde tempest-ServerActionsTestOtherB-856597999 tempest-ServerActionsTestOtherB-856597999-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 534.625302] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-3d6f2696-c02e-4d99-9225-f569a7878bde tempest-ServerActionsTestOtherB-856597999 tempest-ServerActionsTestOtherB-856597999-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 534.630191] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-3d6f2696-c02e-4d99-9225-f569a7878bde tempest-ServerActionsTestOtherB-856597999 tempest-ServerActionsTestOtherB-856597999-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'a93c0169-490e-4cd2-b890-5e1d8aecae59', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 534.630191] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-3d6f2696-c02e-4d99-9225-f569a7878bde tempest-ServerActionsTestOtherB-856597999 tempest-ServerActionsTestOtherB-856597999-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.005s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 534.630191] nova-scheduler[51961]: DEBUG nova.filters [None req-3d6f2696-c02e-4d99-9225-f569a7878bde tempest-ServerActionsTestOtherB-856597999 tempest-ServerActionsTestOtherB-856597999-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 534.630397] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-3d6f2696-c02e-4d99-9225-f569a7878bde tempest-ServerActionsTestOtherB-856597999 tempest-ServerActionsTestOtherB-856597999-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 60.492047 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 534.630397] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-3d6f2696-c02e-4d99-9225-f569a7878bde tempest-ServerActionsTestOtherB-856597999 tempest-ServerActionsTestOtherB-856597999-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 534.630397] nova-scheduler[51961]: INFO nova.filters [None req-3d6f2696-c02e-4d99-9225-f569a7878bde tempest-ServerActionsTestOtherB-856597999 tempest-ServerActionsTestOtherB-856597999-project-member] Filter ComputeFilter returned 0 hosts [ 534.630397] nova-scheduler[51961]: DEBUG nova.filters [None req-3d6f2696-c02e-4d99-9225-f569a7878bde tempest-ServerActionsTestOtherB-856597999 tempest-ServerActionsTestOtherB-856597999-project-member] Filtering removed all hosts for the request with instance ID '6829148d-8c80-4cbd-b6db-ed1855d4174e'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 534.630531] nova-scheduler[51961]: INFO nova.filters [None req-3d6f2696-c02e-4d99-9225-f569a7878bde tempest-ServerActionsTestOtherB-856597999 tempest-ServerActionsTestOtherB-856597999-project-member] Filtering removed all hosts for the request with instance ID '6829148d-8c80-4cbd-b6db-ed1855d4174e'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 534.630689] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-3d6f2696-c02e-4d99-9225-f569a7878bde tempest-ServerActionsTestOtherB-856597999 tempest-ServerActionsTestOtherB-856597999-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 534.630863] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-3d6f2696-c02e-4d99-9225-f569a7878bde tempest-ServerActionsTestOtherB-856597999 tempest-ServerActionsTestOtherB-856597999-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 536.342089] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-f55a4e7d-ad0c-4c5a-b8d9-d8b186d99991 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Starting to schedule for instances: ['6054720c-ce85-4211-b9db-6fa6b5d6291f'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 536.342490] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-f55a4e7d-ad0c-4c5a-b8d9-d8b186d99991 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 536.342581] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-f55a4e7d-ad0c-4c5a-b8d9-d8b186d99991 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 536.342769] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-f55a4e7d-ad0c-4c5a-b8d9-d8b186d99991 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 536.342983] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-f55a4e7d-ad0c-4c5a-b8d9-d8b186d99991 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 536.343226] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-f55a4e7d-ad0c-4c5a-b8d9-d8b186d99991 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 536.397708] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-f55a4e7d-ad0c-4c5a-b8d9-d8b186d99991 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 536.397708] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-f55a4e7d-ad0c-4c5a-b8d9-d8b186d99991 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 536.397708] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-f55a4e7d-ad0c-4c5a-b8d9-d8b186d99991 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 536.409645] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-f55a4e7d-ad0c-4c5a-b8d9-d8b186d99991 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 536.410083] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-f55a4e7d-ad0c-4c5a-b8d9-d8b186d99991 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 536.411681] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-f55a4e7d-ad0c-4c5a-b8d9-d8b186d99991 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 536.416060] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-f55a4e7d-ad0c-4c5a-b8d9-d8b186d99991 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 536.416060] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-f55a4e7d-ad0c-4c5a-b8d9-d8b186d99991 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 536.416411] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-f55a4e7d-ad0c-4c5a-b8d9-d8b186d99991 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='1',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:02:25Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 536.416489] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-f55a4e7d-ad0c-4c5a-b8d9-d8b186d99991 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 536.416489] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-f55a4e7d-ad0c-4c5a-b8d9-d8b186d99991 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 536.416489] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-f55a4e7d-ad0c-4c5a-b8d9-d8b186d99991 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'a93c0169-490e-4cd2-b890-5e1d8aecae59', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 536.416629] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-f55a4e7d-ad0c-4c5a-b8d9-d8b186d99991 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 536.416629] nova-scheduler[51959]: DEBUG nova.filters [None req-f55a4e7d-ad0c-4c5a-b8d9-d8b186d99991 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 536.417186] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-f55a4e7d-ad0c-4c5a-b8d9-d8b186d99991 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 62.278316 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 536.417560] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-f55a4e7d-ad0c-4c5a-b8d9-d8b186d99991 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 536.417875] nova-scheduler[51959]: INFO nova.filters [None req-f55a4e7d-ad0c-4c5a-b8d9-d8b186d99991 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Filter ComputeFilter returned 0 hosts [ 536.418195] nova-scheduler[51959]: DEBUG nova.filters [None req-f55a4e7d-ad0c-4c5a-b8d9-d8b186d99991 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Filtering removed all hosts for the request with instance ID '6054720c-ce85-4211-b9db-6fa6b5d6291f'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 536.418451] nova-scheduler[51959]: INFO nova.filters [None req-f55a4e7d-ad0c-4c5a-b8d9-d8b186d99991 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Filtering removed all hosts for the request with instance ID '6054720c-ce85-4211-b9db-6fa6b5d6291f'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 536.418852] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-f55a4e7d-ad0c-4c5a-b8d9-d8b186d99991 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 536.419315] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-f55a4e7d-ad0c-4c5a-b8d9-d8b186d99991 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 536.430136] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-9a159fc1-b7d9-44c4-ac35-26bd31342f37 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Starting to schedule for instances: ['19276da7-bbeb-47f8-9d9e-e267034c2ad6'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 536.430532] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-9a159fc1-b7d9-44c4-ac35-26bd31342f37 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 536.431329] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-9a159fc1-b7d9-44c4-ac35-26bd31342f37 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 536.431329] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-9a159fc1-b7d9-44c4-ac35-26bd31342f37 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 536.431329] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-9a159fc1-b7d9-44c4-ac35-26bd31342f37 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 536.431488] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-9a159fc1-b7d9-44c4-ac35-26bd31342f37 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 536.479481] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9a159fc1-b7d9-44c4-ac35-26bd31342f37 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 536.479481] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9a159fc1-b7d9-44c4-ac35-26bd31342f37 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 536.480392] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9a159fc1-b7d9-44c4-ac35-26bd31342f37 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 536.494834] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9a159fc1-b7d9-44c4-ac35-26bd31342f37 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 536.494834] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9a159fc1-b7d9-44c4-ac35-26bd31342f37 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 536.494834] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9a159fc1-b7d9-44c4-ac35-26bd31342f37 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 536.496060] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9a159fc1-b7d9-44c4-ac35-26bd31342f37 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 536.496278] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9a159fc1-b7d9-44c4-ac35-26bd31342f37 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 536.496671] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-9a159fc1-b7d9-44c4-ac35-26bd31342f37 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='1',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:02:25Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 536.497203] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-9a159fc1-b7d9-44c4-ac35-26bd31342f37 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 536.497325] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-9a159fc1-b7d9-44c4-ac35-26bd31342f37 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 536.497504] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-9a159fc1-b7d9-44c4-ac35-26bd31342f37 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'a93c0169-490e-4cd2-b890-5e1d8aecae59', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 536.497678] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9a159fc1-b7d9-44c4-ac35-26bd31342f37 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 536.497947] nova-scheduler[51961]: DEBUG nova.filters [None req-9a159fc1-b7d9-44c4-ac35-26bd31342f37 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 536.498177] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-9a159fc1-b7d9-44c4-ac35-26bd31342f37 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 62.360401 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 536.498370] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-9a159fc1-b7d9-44c4-ac35-26bd31342f37 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 536.498492] nova-scheduler[51961]: INFO nova.filters [None req-9a159fc1-b7d9-44c4-ac35-26bd31342f37 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Filter ComputeFilter returned 0 hosts [ 536.499265] nova-scheduler[51961]: DEBUG nova.filters [None req-9a159fc1-b7d9-44c4-ac35-26bd31342f37 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Filtering removed all hosts for the request with instance ID '19276da7-bbeb-47f8-9d9e-e267034c2ad6'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 536.499265] nova-scheduler[51961]: INFO nova.filters [None req-9a159fc1-b7d9-44c4-ac35-26bd31342f37 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Filtering removed all hosts for the request with instance ID '19276da7-bbeb-47f8-9d9e-e267034c2ad6'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 536.499265] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-9a159fc1-b7d9-44c4-ac35-26bd31342f37 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 536.499265] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-9a159fc1-b7d9-44c4-ac35-26bd31342f37 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 536.689079] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-474a01ad-f140-4343-8653-4c902e581fbe tempest-ServerDiagnosticsV248Test-907938389 tempest-ServerDiagnosticsV248Test-907938389-project-member] Starting to schedule for instances: ['226e7ed5-7ec6-4564-b88c-31c7753e9d60'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 536.689401] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-474a01ad-f140-4343-8653-4c902e581fbe tempest-ServerDiagnosticsV248Test-907938389 tempest-ServerDiagnosticsV248Test-907938389-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 536.689570] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-474a01ad-f140-4343-8653-4c902e581fbe tempest-ServerDiagnosticsV248Test-907938389 tempest-ServerDiagnosticsV248Test-907938389-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 536.689756] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-474a01ad-f140-4343-8653-4c902e581fbe tempest-ServerDiagnosticsV248Test-907938389 tempest-ServerDiagnosticsV248Test-907938389-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 536.690160] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-474a01ad-f140-4343-8653-4c902e581fbe tempest-ServerDiagnosticsV248Test-907938389 tempest-ServerDiagnosticsV248Test-907938389-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 536.695069] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-474a01ad-f140-4343-8653-4c902e581fbe tempest-ServerDiagnosticsV248Test-907938389 tempest-ServerDiagnosticsV248Test-907938389-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 536.743665] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-474a01ad-f140-4343-8653-4c902e581fbe tempest-ServerDiagnosticsV248Test-907938389 tempest-ServerDiagnosticsV248Test-907938389-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 536.744231] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-474a01ad-f140-4343-8653-4c902e581fbe tempest-ServerDiagnosticsV248Test-907938389 tempest-ServerDiagnosticsV248Test-907938389-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 536.744557] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-474a01ad-f140-4343-8653-4c902e581fbe tempest-ServerDiagnosticsV248Test-907938389 tempest-ServerDiagnosticsV248Test-907938389-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 536.753454] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-474a01ad-f140-4343-8653-4c902e581fbe tempest-ServerDiagnosticsV248Test-907938389 tempest-ServerDiagnosticsV248Test-907938389-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 536.755093] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-474a01ad-f140-4343-8653-4c902e581fbe tempest-ServerDiagnosticsV248Test-907938389 tempest-ServerDiagnosticsV248Test-907938389-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 536.755093] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-474a01ad-f140-4343-8653-4c902e581fbe tempest-ServerDiagnosticsV248Test-907938389 tempest-ServerDiagnosticsV248Test-907938389-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 536.757027] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-474a01ad-f140-4343-8653-4c902e581fbe tempest-ServerDiagnosticsV248Test-907938389 tempest-ServerDiagnosticsV248Test-907938389-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 536.757353] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-474a01ad-f140-4343-8653-4c902e581fbe tempest-ServerDiagnosticsV248Test-907938389 tempest-ServerDiagnosticsV248Test-907938389-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 536.758240] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-474a01ad-f140-4343-8653-4c902e581fbe tempest-ServerDiagnosticsV248Test-907938389 tempest-ServerDiagnosticsV248Test-907938389-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='1',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:02:25Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 536.758414] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-474a01ad-f140-4343-8653-4c902e581fbe tempest-ServerDiagnosticsV248Test-907938389 tempest-ServerDiagnosticsV248Test-907938389-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 536.759027] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-474a01ad-f140-4343-8653-4c902e581fbe tempest-ServerDiagnosticsV248Test-907938389 tempest-ServerDiagnosticsV248Test-907938389-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 536.759027] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-474a01ad-f140-4343-8653-4c902e581fbe tempest-ServerDiagnosticsV248Test-907938389 tempest-ServerDiagnosticsV248Test-907938389-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'a93c0169-490e-4cd2-b890-5e1d8aecae59', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 536.759214] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-474a01ad-f140-4343-8653-4c902e581fbe tempest-ServerDiagnosticsV248Test-907938389 tempest-ServerDiagnosticsV248Test-907938389-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 536.759765] nova-scheduler[51959]: DEBUG nova.filters [None req-474a01ad-f140-4343-8653-4c902e581fbe tempest-ServerDiagnosticsV248Test-907938389 tempest-ServerDiagnosticsV248Test-907938389-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 536.760031] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-474a01ad-f140-4343-8653-4c902e581fbe tempest-ServerDiagnosticsV248Test-907938389 tempest-ServerDiagnosticsV248Test-907938389-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 62.62223 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 536.760356] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-474a01ad-f140-4343-8653-4c902e581fbe tempest-ServerDiagnosticsV248Test-907938389 tempest-ServerDiagnosticsV248Test-907938389-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 536.760404] nova-scheduler[51959]: INFO nova.filters [None req-474a01ad-f140-4343-8653-4c902e581fbe tempest-ServerDiagnosticsV248Test-907938389 tempest-ServerDiagnosticsV248Test-907938389-project-member] Filter ComputeFilter returned 0 hosts [ 536.760570] nova-scheduler[51959]: DEBUG nova.filters [None req-474a01ad-f140-4343-8653-4c902e581fbe tempest-ServerDiagnosticsV248Test-907938389 tempest-ServerDiagnosticsV248Test-907938389-project-member] Filtering removed all hosts for the request with instance ID '226e7ed5-7ec6-4564-b88c-31c7753e9d60'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 536.760739] nova-scheduler[51959]: INFO nova.filters [None req-474a01ad-f140-4343-8653-4c902e581fbe tempest-ServerDiagnosticsV248Test-907938389 tempest-ServerDiagnosticsV248Test-907938389-project-member] Filtering removed all hosts for the request with instance ID '226e7ed5-7ec6-4564-b88c-31c7753e9d60'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 536.760905] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-474a01ad-f140-4343-8653-4c902e581fbe tempest-ServerDiagnosticsV248Test-907938389 tempest-ServerDiagnosticsV248Test-907938389-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 536.761053] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-474a01ad-f140-4343-8653-4c902e581fbe tempest-ServerDiagnosticsV248Test-907938389 tempest-ServerDiagnosticsV248Test-907938389-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 537.505194] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-ff7cb8e1-a721-43fd-89b9-860f3db6a652 tempest-ImagesNegativeTestJSON-1710658454 tempest-ImagesNegativeTestJSON-1710658454-project-member] Starting to schedule for instances: ['6791f0d3-b7af-4a3f-8d49-8dd401a95a1f'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 537.505688] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-ff7cb8e1-a721-43fd-89b9-860f3db6a652 tempest-ImagesNegativeTestJSON-1710658454 tempest-ImagesNegativeTestJSON-1710658454-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 537.505850] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-ff7cb8e1-a721-43fd-89b9-860f3db6a652 tempest-ImagesNegativeTestJSON-1710658454 tempest-ImagesNegativeTestJSON-1710658454-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 537.506064] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-ff7cb8e1-a721-43fd-89b9-860f3db6a652 tempest-ImagesNegativeTestJSON-1710658454 tempest-ImagesNegativeTestJSON-1710658454-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 537.506283] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-ff7cb8e1-a721-43fd-89b9-860f3db6a652 tempest-ImagesNegativeTestJSON-1710658454 tempest-ImagesNegativeTestJSON-1710658454-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 537.506600] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-ff7cb8e1-a721-43fd-89b9-860f3db6a652 tempest-ImagesNegativeTestJSON-1710658454 tempest-ImagesNegativeTestJSON-1710658454-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 537.560747] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-ff7cb8e1-a721-43fd-89b9-860f3db6a652 tempest-ImagesNegativeTestJSON-1710658454 tempest-ImagesNegativeTestJSON-1710658454-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 537.560747] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-ff7cb8e1-a721-43fd-89b9-860f3db6a652 tempest-ImagesNegativeTestJSON-1710658454 tempest-ImagesNegativeTestJSON-1710658454-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 537.560747] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-ff7cb8e1-a721-43fd-89b9-860f3db6a652 tempest-ImagesNegativeTestJSON-1710658454 tempest-ImagesNegativeTestJSON-1710658454-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 537.573205] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-ff7cb8e1-a721-43fd-89b9-860f3db6a652 tempest-ImagesNegativeTestJSON-1710658454 tempest-ImagesNegativeTestJSON-1710658454-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 537.573205] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-ff7cb8e1-a721-43fd-89b9-860f3db6a652 tempest-ImagesNegativeTestJSON-1710658454 tempest-ImagesNegativeTestJSON-1710658454-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 537.573205] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-ff7cb8e1-a721-43fd-89b9-860f3db6a652 tempest-ImagesNegativeTestJSON-1710658454 tempest-ImagesNegativeTestJSON-1710658454-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 537.576553] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-ff7cb8e1-a721-43fd-89b9-860f3db6a652 tempest-ImagesNegativeTestJSON-1710658454 tempest-ImagesNegativeTestJSON-1710658454-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 537.577336] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-ff7cb8e1-a721-43fd-89b9-860f3db6a652 tempest-ImagesNegativeTestJSON-1710658454 tempest-ImagesNegativeTestJSON-1710658454-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 537.577588] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-ff7cb8e1-a721-43fd-89b9-860f3db6a652 tempest-ImagesNegativeTestJSON-1710658454 tempest-ImagesNegativeTestJSON-1710658454-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='1',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:02:25Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 537.577716] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-ff7cb8e1-a721-43fd-89b9-860f3db6a652 tempest-ImagesNegativeTestJSON-1710658454 tempest-ImagesNegativeTestJSON-1710658454-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 537.577716] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-ff7cb8e1-a721-43fd-89b9-860f3db6a652 tempest-ImagesNegativeTestJSON-1710658454 tempest-ImagesNegativeTestJSON-1710658454-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 537.577864] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-ff7cb8e1-a721-43fd-89b9-860f3db6a652 tempest-ImagesNegativeTestJSON-1710658454 tempest-ImagesNegativeTestJSON-1710658454-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'a93c0169-490e-4cd2-b890-5e1d8aecae59', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 537.578015] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-ff7cb8e1-a721-43fd-89b9-860f3db6a652 tempest-ImagesNegativeTestJSON-1710658454 tempest-ImagesNegativeTestJSON-1710658454-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 537.583615] nova-scheduler[51961]: DEBUG nova.filters [None req-ff7cb8e1-a721-43fd-89b9-860f3db6a652 tempest-ImagesNegativeTestJSON-1710658454 tempest-ImagesNegativeTestJSON-1710658454-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 537.583615] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-ff7cb8e1-a721-43fd-89b9-860f3db6a652 tempest-ImagesNegativeTestJSON-1710658454 tempest-ImagesNegativeTestJSON-1710658454-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 63.445304 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 537.583615] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-ff7cb8e1-a721-43fd-89b9-860f3db6a652 tempest-ImagesNegativeTestJSON-1710658454 tempest-ImagesNegativeTestJSON-1710658454-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 537.583615] nova-scheduler[51961]: INFO nova.filters [None req-ff7cb8e1-a721-43fd-89b9-860f3db6a652 tempest-ImagesNegativeTestJSON-1710658454 tempest-ImagesNegativeTestJSON-1710658454-project-member] Filter ComputeFilter returned 0 hosts [ 537.583615] nova-scheduler[51961]: DEBUG nova.filters [None req-ff7cb8e1-a721-43fd-89b9-860f3db6a652 tempest-ImagesNegativeTestJSON-1710658454 tempest-ImagesNegativeTestJSON-1710658454-project-member] Filtering removed all hosts for the request with instance ID '6791f0d3-b7af-4a3f-8d49-8dd401a95a1f'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 537.583861] nova-scheduler[51961]: INFO nova.filters [None req-ff7cb8e1-a721-43fd-89b9-860f3db6a652 tempest-ImagesNegativeTestJSON-1710658454 tempest-ImagesNegativeTestJSON-1710658454-project-member] Filtering removed all hosts for the request with instance ID '6791f0d3-b7af-4a3f-8d49-8dd401a95a1f'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 537.583930] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-ff7cb8e1-a721-43fd-89b9-860f3db6a652 tempest-ImagesNegativeTestJSON-1710658454 tempest-ImagesNegativeTestJSON-1710658454-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 537.584116] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-ff7cb8e1-a721-43fd-89b9-860f3db6a652 tempest-ImagesNegativeTestJSON-1710658454 tempest-ImagesNegativeTestJSON-1710658454-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 538.045084] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-038328a3-4db2-4867-9f30-b687e5864aaa tempest-FloatingIPsAssociationTestJSON-1605085979 tempest-FloatingIPsAssociationTestJSON-1605085979-project-member] Starting to schedule for instances: ['a0411d73-cf00-4d1e-ba3d-3c148505f015'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 538.050020] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-038328a3-4db2-4867-9f30-b687e5864aaa tempest-FloatingIPsAssociationTestJSON-1605085979 tempest-FloatingIPsAssociationTestJSON-1605085979-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 538.050020] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-038328a3-4db2-4867-9f30-b687e5864aaa tempest-FloatingIPsAssociationTestJSON-1605085979 tempest-FloatingIPsAssociationTestJSON-1605085979-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 538.050020] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-038328a3-4db2-4867-9f30-b687e5864aaa tempest-FloatingIPsAssociationTestJSON-1605085979 tempest-FloatingIPsAssociationTestJSON-1605085979-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 538.050020] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-038328a3-4db2-4867-9f30-b687e5864aaa tempest-FloatingIPsAssociationTestJSON-1605085979 tempest-FloatingIPsAssociationTestJSON-1605085979-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 538.050475] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-038328a3-4db2-4867-9f30-b687e5864aaa tempest-FloatingIPsAssociationTestJSON-1605085979 tempest-FloatingIPsAssociationTestJSON-1605085979-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 538.103031] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-038328a3-4db2-4867-9f30-b687e5864aaa tempest-FloatingIPsAssociationTestJSON-1605085979 tempest-FloatingIPsAssociationTestJSON-1605085979-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 538.103031] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-038328a3-4db2-4867-9f30-b687e5864aaa tempest-FloatingIPsAssociationTestJSON-1605085979 tempest-FloatingIPsAssociationTestJSON-1605085979-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 538.103031] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-038328a3-4db2-4867-9f30-b687e5864aaa tempest-FloatingIPsAssociationTestJSON-1605085979 tempest-FloatingIPsAssociationTestJSON-1605085979-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 538.109922] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-038328a3-4db2-4867-9f30-b687e5864aaa tempest-FloatingIPsAssociationTestJSON-1605085979 tempest-FloatingIPsAssociationTestJSON-1605085979-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 538.110242] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-038328a3-4db2-4867-9f30-b687e5864aaa tempest-FloatingIPsAssociationTestJSON-1605085979 tempest-FloatingIPsAssociationTestJSON-1605085979-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 538.110458] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-038328a3-4db2-4867-9f30-b687e5864aaa tempest-FloatingIPsAssociationTestJSON-1605085979 tempest-FloatingIPsAssociationTestJSON-1605085979-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 538.112818] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-038328a3-4db2-4867-9f30-b687e5864aaa tempest-FloatingIPsAssociationTestJSON-1605085979 tempest-FloatingIPsAssociationTestJSON-1605085979-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 538.113077] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-038328a3-4db2-4867-9f30-b687e5864aaa tempest-FloatingIPsAssociationTestJSON-1605085979 tempest-FloatingIPsAssociationTestJSON-1605085979-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 538.113493] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-038328a3-4db2-4867-9f30-b687e5864aaa tempest-FloatingIPsAssociationTestJSON-1605085979 tempest-FloatingIPsAssociationTestJSON-1605085979-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='1',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:02:25Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 538.113835] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-038328a3-4db2-4867-9f30-b687e5864aaa tempest-FloatingIPsAssociationTestJSON-1605085979 tempest-FloatingIPsAssociationTestJSON-1605085979-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 538.114059] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-038328a3-4db2-4867-9f30-b687e5864aaa tempest-FloatingIPsAssociationTestJSON-1605085979 tempest-FloatingIPsAssociationTestJSON-1605085979-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 538.114299] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-038328a3-4db2-4867-9f30-b687e5864aaa tempest-FloatingIPsAssociationTestJSON-1605085979 tempest-FloatingIPsAssociationTestJSON-1605085979-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'a93c0169-490e-4cd2-b890-5e1d8aecae59', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 538.114519] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-038328a3-4db2-4867-9f30-b687e5864aaa tempest-FloatingIPsAssociationTestJSON-1605085979 tempest-FloatingIPsAssociationTestJSON-1605085979-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 538.114834] nova-scheduler[51959]: DEBUG nova.filters [None req-038328a3-4db2-4867-9f30-b687e5864aaa tempest-FloatingIPsAssociationTestJSON-1605085979 tempest-FloatingIPsAssociationTestJSON-1605085979-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 538.115124] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-038328a3-4db2-4867-9f30-b687e5864aaa tempest-FloatingIPsAssociationTestJSON-1605085979 tempest-FloatingIPsAssociationTestJSON-1605085979-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 63.977293 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 538.115333] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-038328a3-4db2-4867-9f30-b687e5864aaa tempest-FloatingIPsAssociationTestJSON-1605085979 tempest-FloatingIPsAssociationTestJSON-1605085979-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 538.115530] nova-scheduler[51959]: INFO nova.filters [None req-038328a3-4db2-4867-9f30-b687e5864aaa tempest-FloatingIPsAssociationTestJSON-1605085979 tempest-FloatingIPsAssociationTestJSON-1605085979-project-member] Filter ComputeFilter returned 0 hosts [ 538.115718] nova-scheduler[51959]: DEBUG nova.filters [None req-038328a3-4db2-4867-9f30-b687e5864aaa tempest-FloatingIPsAssociationTestJSON-1605085979 tempest-FloatingIPsAssociationTestJSON-1605085979-project-member] Filtering removed all hosts for the request with instance ID 'a0411d73-cf00-4d1e-ba3d-3c148505f015'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 538.115907] nova-scheduler[51959]: INFO nova.filters [None req-038328a3-4db2-4867-9f30-b687e5864aaa tempest-FloatingIPsAssociationTestJSON-1605085979 tempest-FloatingIPsAssociationTestJSON-1605085979-project-member] Filtering removed all hosts for the request with instance ID 'a0411d73-cf00-4d1e-ba3d-3c148505f015'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 538.116118] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-038328a3-4db2-4867-9f30-b687e5864aaa tempest-FloatingIPsAssociationTestJSON-1605085979 tempest-FloatingIPsAssociationTestJSON-1605085979-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 538.116362] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-038328a3-4db2-4867-9f30-b687e5864aaa tempest-FloatingIPsAssociationTestJSON-1605085979 tempest-FloatingIPsAssociationTestJSON-1605085979-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 541.556415] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-c4e8c592-64b2-491e-a697-f011ad0a0940 tempest-VolumesAssistedSnapshotsTest-1491090689 tempest-VolumesAssistedSnapshotsTest-1491090689-project-member] Starting to schedule for instances: ['414c8db3-1552-48f8-9231-6b39f8d54b37'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 541.556714] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c4e8c592-64b2-491e-a697-f011ad0a0940 tempest-VolumesAssistedSnapshotsTest-1491090689 tempest-VolumesAssistedSnapshotsTest-1491090689-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 541.556879] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c4e8c592-64b2-491e-a697-f011ad0a0940 tempest-VolumesAssistedSnapshotsTest-1491090689 tempest-VolumesAssistedSnapshotsTest-1491090689-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 541.557335] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c4e8c592-64b2-491e-a697-f011ad0a0940 tempest-VolumesAssistedSnapshotsTest-1491090689 tempest-VolumesAssistedSnapshotsTest-1491090689-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 541.557596] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c4e8c592-64b2-491e-a697-f011ad0a0940 tempest-VolumesAssistedSnapshotsTest-1491090689 tempest-VolumesAssistedSnapshotsTest-1491090689-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 541.559101] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c4e8c592-64b2-491e-a697-f011ad0a0940 tempest-VolumesAssistedSnapshotsTest-1491090689 tempest-VolumesAssistedSnapshotsTest-1491090689-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 541.610135] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c4e8c592-64b2-491e-a697-f011ad0a0940 tempest-VolumesAssistedSnapshotsTest-1491090689 tempest-VolumesAssistedSnapshotsTest-1491090689-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 541.610272] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c4e8c592-64b2-491e-a697-f011ad0a0940 tempest-VolumesAssistedSnapshotsTest-1491090689 tempest-VolumesAssistedSnapshotsTest-1491090689-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 541.610493] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c4e8c592-64b2-491e-a697-f011ad0a0940 tempest-VolumesAssistedSnapshotsTest-1491090689 tempest-VolumesAssistedSnapshotsTest-1491090689-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 541.620120] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c4e8c592-64b2-491e-a697-f011ad0a0940 tempest-VolumesAssistedSnapshotsTest-1491090689 tempest-VolumesAssistedSnapshotsTest-1491090689-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 541.620365] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c4e8c592-64b2-491e-a697-f011ad0a0940 tempest-VolumesAssistedSnapshotsTest-1491090689 tempest-VolumesAssistedSnapshotsTest-1491090689-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 541.620541] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c4e8c592-64b2-491e-a697-f011ad0a0940 tempest-VolumesAssistedSnapshotsTest-1491090689 tempest-VolumesAssistedSnapshotsTest-1491090689-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 541.626403] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c4e8c592-64b2-491e-a697-f011ad0a0940 tempest-VolumesAssistedSnapshotsTest-1491090689 tempest-VolumesAssistedSnapshotsTest-1491090689-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 541.626637] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c4e8c592-64b2-491e-a697-f011ad0a0940 tempest-VolumesAssistedSnapshotsTest-1491090689 tempest-VolumesAssistedSnapshotsTest-1491090689-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 541.627071] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-c4e8c592-64b2-491e-a697-f011ad0a0940 tempest-VolumesAssistedSnapshotsTest-1491090689 tempest-VolumesAssistedSnapshotsTest-1491090689-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='1',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:02:25Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 541.627652] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-c4e8c592-64b2-491e-a697-f011ad0a0940 tempest-VolumesAssistedSnapshotsTest-1491090689 tempest-VolumesAssistedSnapshotsTest-1491090689-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 541.627652] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-c4e8c592-64b2-491e-a697-f011ad0a0940 tempest-VolumesAssistedSnapshotsTest-1491090689 tempest-VolumesAssistedSnapshotsTest-1491090689-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 541.627769] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-c4e8c592-64b2-491e-a697-f011ad0a0940 tempest-VolumesAssistedSnapshotsTest-1491090689 tempest-VolumesAssistedSnapshotsTest-1491090689-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'a93c0169-490e-4cd2-b890-5e1d8aecae59', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 541.627897] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c4e8c592-64b2-491e-a697-f011ad0a0940 tempest-VolumesAssistedSnapshotsTest-1491090689 tempest-VolumesAssistedSnapshotsTest-1491090689-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 541.628200] nova-scheduler[51961]: DEBUG nova.filters [None req-c4e8c592-64b2-491e-a697-f011ad0a0940 tempest-VolumesAssistedSnapshotsTest-1491090689 tempest-VolumesAssistedSnapshotsTest-1491090689-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 541.628423] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-c4e8c592-64b2-491e-a697-f011ad0a0940 tempest-VolumesAssistedSnapshotsTest-1491090689 tempest-VolumesAssistedSnapshotsTest-1491090689-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 67.490657 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 541.628776] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-c4e8c592-64b2-491e-a697-f011ad0a0940 tempest-VolumesAssistedSnapshotsTest-1491090689 tempest-VolumesAssistedSnapshotsTest-1491090689-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 541.628776] nova-scheduler[51961]: INFO nova.filters [None req-c4e8c592-64b2-491e-a697-f011ad0a0940 tempest-VolumesAssistedSnapshotsTest-1491090689 tempest-VolumesAssistedSnapshotsTest-1491090689-project-member] Filter ComputeFilter returned 0 hosts [ 541.628927] nova-scheduler[51961]: DEBUG nova.filters [None req-c4e8c592-64b2-491e-a697-f011ad0a0940 tempest-VolumesAssistedSnapshotsTest-1491090689 tempest-VolumesAssistedSnapshotsTest-1491090689-project-member] Filtering removed all hosts for the request with instance ID '414c8db3-1552-48f8-9231-6b39f8d54b37'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 541.629107] nova-scheduler[51961]: INFO nova.filters [None req-c4e8c592-64b2-491e-a697-f011ad0a0940 tempest-VolumesAssistedSnapshotsTest-1491090689 tempest-VolumesAssistedSnapshotsTest-1491090689-project-member] Filtering removed all hosts for the request with instance ID '414c8db3-1552-48f8-9231-6b39f8d54b37'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 541.629486] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-c4e8c592-64b2-491e-a697-f011ad0a0940 tempest-VolumesAssistedSnapshotsTest-1491090689 tempest-VolumesAssistedSnapshotsTest-1491090689-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 541.629486] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-c4e8c592-64b2-491e-a697-f011ad0a0940 tempest-VolumesAssistedSnapshotsTest-1491090689 tempest-VolumesAssistedSnapshotsTest-1491090689-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 544.060348] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-f4be070b-8111-4de1-8d26-83a281f34390 tempest-ServerMetadataNegativeTestJSON-1596432718 tempest-ServerMetadataNegativeTestJSON-1596432718-project-member] Starting to schedule for instances: ['432c69c7-6f6c-4790-8ef9-d405cc9bf158'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 544.060348] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-f4be070b-8111-4de1-8d26-83a281f34390 tempest-ServerMetadataNegativeTestJSON-1596432718 tempest-ServerMetadataNegativeTestJSON-1596432718-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 544.060348] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-f4be070b-8111-4de1-8d26-83a281f34390 tempest-ServerMetadataNegativeTestJSON-1596432718 tempest-ServerMetadataNegativeTestJSON-1596432718-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 544.060348] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-f4be070b-8111-4de1-8d26-83a281f34390 tempest-ServerMetadataNegativeTestJSON-1596432718 tempest-ServerMetadataNegativeTestJSON-1596432718-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 544.060641] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-f4be070b-8111-4de1-8d26-83a281f34390 tempest-ServerMetadataNegativeTestJSON-1596432718 tempest-ServerMetadataNegativeTestJSON-1596432718-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 544.060641] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-f4be070b-8111-4de1-8d26-83a281f34390 tempest-ServerMetadataNegativeTestJSON-1596432718 tempest-ServerMetadataNegativeTestJSON-1596432718-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 544.117897] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-f4be070b-8111-4de1-8d26-83a281f34390 tempest-ServerMetadataNegativeTestJSON-1596432718 tempest-ServerMetadataNegativeTestJSON-1596432718-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 544.118190] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-f4be070b-8111-4de1-8d26-83a281f34390 tempest-ServerMetadataNegativeTestJSON-1596432718 tempest-ServerMetadataNegativeTestJSON-1596432718-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 544.118393] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-f4be070b-8111-4de1-8d26-83a281f34390 tempest-ServerMetadataNegativeTestJSON-1596432718 tempest-ServerMetadataNegativeTestJSON-1596432718-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 544.125316] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-f4be070b-8111-4de1-8d26-83a281f34390 tempest-ServerMetadataNegativeTestJSON-1596432718 tempest-ServerMetadataNegativeTestJSON-1596432718-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 544.125526] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-f4be070b-8111-4de1-8d26-83a281f34390 tempest-ServerMetadataNegativeTestJSON-1596432718 tempest-ServerMetadataNegativeTestJSON-1596432718-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 544.126216] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-f4be070b-8111-4de1-8d26-83a281f34390 tempest-ServerMetadataNegativeTestJSON-1596432718 tempest-ServerMetadataNegativeTestJSON-1596432718-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 544.128197] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-f4be070b-8111-4de1-8d26-83a281f34390 tempest-ServerMetadataNegativeTestJSON-1596432718 tempest-ServerMetadataNegativeTestJSON-1596432718-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 544.128407] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-f4be070b-8111-4de1-8d26-83a281f34390 tempest-ServerMetadataNegativeTestJSON-1596432718 tempest-ServerMetadataNegativeTestJSON-1596432718-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 544.128793] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-f4be070b-8111-4de1-8d26-83a281f34390 tempest-ServerMetadataNegativeTestJSON-1596432718 tempest-ServerMetadataNegativeTestJSON-1596432718-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='1',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:02:25Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 544.129104] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-f4be070b-8111-4de1-8d26-83a281f34390 tempest-ServerMetadataNegativeTestJSON-1596432718 tempest-ServerMetadataNegativeTestJSON-1596432718-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 544.129284] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-f4be070b-8111-4de1-8d26-83a281f34390 tempest-ServerMetadataNegativeTestJSON-1596432718 tempest-ServerMetadataNegativeTestJSON-1596432718-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 544.129448] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-f4be070b-8111-4de1-8d26-83a281f34390 tempest-ServerMetadataNegativeTestJSON-1596432718 tempest-ServerMetadataNegativeTestJSON-1596432718-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'a93c0169-490e-4cd2-b890-5e1d8aecae59', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 544.129617] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-f4be070b-8111-4de1-8d26-83a281f34390 tempest-ServerMetadataNegativeTestJSON-1596432718 tempest-ServerMetadataNegativeTestJSON-1596432718-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 544.129875] nova-scheduler[51959]: DEBUG nova.filters [None req-f4be070b-8111-4de1-8d26-83a281f34390 tempest-ServerMetadataNegativeTestJSON-1596432718 tempest-ServerMetadataNegativeTestJSON-1596432718-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 544.130107] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-f4be070b-8111-4de1-8d26-83a281f34390 tempest-ServerMetadataNegativeTestJSON-1596432718 tempest-ServerMetadataNegativeTestJSON-1596432718-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 69.99233 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 544.130274] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-f4be070b-8111-4de1-8d26-83a281f34390 tempest-ServerMetadataNegativeTestJSON-1596432718 tempest-ServerMetadataNegativeTestJSON-1596432718-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 544.130435] nova-scheduler[51959]: INFO nova.filters [None req-f4be070b-8111-4de1-8d26-83a281f34390 tempest-ServerMetadataNegativeTestJSON-1596432718 tempest-ServerMetadataNegativeTestJSON-1596432718-project-member] Filter ComputeFilter returned 0 hosts [ 544.130588] nova-scheduler[51959]: DEBUG nova.filters [None req-f4be070b-8111-4de1-8d26-83a281f34390 tempest-ServerMetadataNegativeTestJSON-1596432718 tempest-ServerMetadataNegativeTestJSON-1596432718-project-member] Filtering removed all hosts for the request with instance ID '432c69c7-6f6c-4790-8ef9-d405cc9bf158'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 544.130771] nova-scheduler[51959]: INFO nova.filters [None req-f4be070b-8111-4de1-8d26-83a281f34390 tempest-ServerMetadataNegativeTestJSON-1596432718 tempest-ServerMetadataNegativeTestJSON-1596432718-project-member] Filtering removed all hosts for the request with instance ID '432c69c7-6f6c-4790-8ef9-d405cc9bf158'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 544.130951] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-f4be070b-8111-4de1-8d26-83a281f34390 tempest-ServerMetadataNegativeTestJSON-1596432718 tempest-ServerMetadataNegativeTestJSON-1596432718-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 544.131118] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-f4be070b-8111-4de1-8d26-83a281f34390 tempest-ServerMetadataNegativeTestJSON-1596432718 tempest-ServerMetadataNegativeTestJSON-1596432718-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 544.386891] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-c2296365-a38c-42ca-ab1d-660922a68cc3 tempest-ServersWithSpecificFlavorTestJSON-207981500 tempest-ServersWithSpecificFlavorTestJSON-207981500-project-member] Starting to schedule for instances: ['395d134b-079c-4191-8fd7-48fd8cec163c'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 544.386891] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c2296365-a38c-42ca-ab1d-660922a68cc3 tempest-ServersWithSpecificFlavorTestJSON-207981500 tempest-ServersWithSpecificFlavorTestJSON-207981500-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 544.386891] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c2296365-a38c-42ca-ab1d-660922a68cc3 tempest-ServersWithSpecificFlavorTestJSON-207981500 tempest-ServersWithSpecificFlavorTestJSON-207981500-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 544.386891] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c2296365-a38c-42ca-ab1d-660922a68cc3 tempest-ServersWithSpecificFlavorTestJSON-207981500 tempest-ServersWithSpecificFlavorTestJSON-207981500-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 544.387335] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c2296365-a38c-42ca-ab1d-660922a68cc3 tempest-ServersWithSpecificFlavorTestJSON-207981500 tempest-ServersWithSpecificFlavorTestJSON-207981500-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 544.387335] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c2296365-a38c-42ca-ab1d-660922a68cc3 tempest-ServersWithSpecificFlavorTestJSON-207981500 tempest-ServersWithSpecificFlavorTestJSON-207981500-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 544.434129] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c2296365-a38c-42ca-ab1d-660922a68cc3 tempest-ServersWithSpecificFlavorTestJSON-207981500 tempest-ServersWithSpecificFlavorTestJSON-207981500-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 544.434384] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c2296365-a38c-42ca-ab1d-660922a68cc3 tempest-ServersWithSpecificFlavorTestJSON-207981500 tempest-ServersWithSpecificFlavorTestJSON-207981500-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 544.434574] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c2296365-a38c-42ca-ab1d-660922a68cc3 tempest-ServersWithSpecificFlavorTestJSON-207981500 tempest-ServersWithSpecificFlavorTestJSON-207981500-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 544.442086] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c2296365-a38c-42ca-ab1d-660922a68cc3 tempest-ServersWithSpecificFlavorTestJSON-207981500 tempest-ServersWithSpecificFlavorTestJSON-207981500-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 544.442409] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c2296365-a38c-42ca-ab1d-660922a68cc3 tempest-ServersWithSpecificFlavorTestJSON-207981500 tempest-ServersWithSpecificFlavorTestJSON-207981500-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 544.442488] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c2296365-a38c-42ca-ab1d-660922a68cc3 tempest-ServersWithSpecificFlavorTestJSON-207981500 tempest-ServersWithSpecificFlavorTestJSON-207981500-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 544.444799] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c2296365-a38c-42ca-ab1d-660922a68cc3 tempest-ServersWithSpecificFlavorTestJSON-207981500 tempest-ServersWithSpecificFlavorTestJSON-207981500-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 544.445019] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c2296365-a38c-42ca-ab1d-660922a68cc3 tempest-ServersWithSpecificFlavorTestJSON-207981500 tempest-ServersWithSpecificFlavorTestJSON-207981500-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 544.445489] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-c2296365-a38c-42ca-ab1d-660922a68cc3 tempest-ServersWithSpecificFlavorTestJSON-207981500 tempest-ServersWithSpecificFlavorTestJSON-207981500-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='1',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:02:25Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 544.445713] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-c2296365-a38c-42ca-ab1d-660922a68cc3 tempest-ServersWithSpecificFlavorTestJSON-207981500 tempest-ServersWithSpecificFlavorTestJSON-207981500-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 544.445891] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-c2296365-a38c-42ca-ab1d-660922a68cc3 tempest-ServersWithSpecificFlavorTestJSON-207981500 tempest-ServersWithSpecificFlavorTestJSON-207981500-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 544.446076] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-c2296365-a38c-42ca-ab1d-660922a68cc3 tempest-ServersWithSpecificFlavorTestJSON-207981500 tempest-ServersWithSpecificFlavorTestJSON-207981500-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'a93c0169-490e-4cd2-b890-5e1d8aecae59', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 544.446281] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c2296365-a38c-42ca-ab1d-660922a68cc3 tempest-ServersWithSpecificFlavorTestJSON-207981500 tempest-ServersWithSpecificFlavorTestJSON-207981500-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 544.446732] nova-scheduler[51961]: DEBUG nova.filters [None req-c2296365-a38c-42ca-ab1d-660922a68cc3 tempest-ServersWithSpecificFlavorTestJSON-207981500 tempest-ServersWithSpecificFlavorTestJSON-207981500-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 544.446732] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-c2296365-a38c-42ca-ab1d-660922a68cc3 tempest-ServersWithSpecificFlavorTestJSON-207981500 tempest-ServersWithSpecificFlavorTestJSON-207981500-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 70.308957 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 544.446885] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-c2296365-a38c-42ca-ab1d-660922a68cc3 tempest-ServersWithSpecificFlavorTestJSON-207981500 tempest-ServersWithSpecificFlavorTestJSON-207981500-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 544.447104] nova-scheduler[51961]: INFO nova.filters [None req-c2296365-a38c-42ca-ab1d-660922a68cc3 tempest-ServersWithSpecificFlavorTestJSON-207981500 tempest-ServersWithSpecificFlavorTestJSON-207981500-project-member] Filter ComputeFilter returned 0 hosts [ 544.447258] nova-scheduler[51961]: DEBUG nova.filters [None req-c2296365-a38c-42ca-ab1d-660922a68cc3 tempest-ServersWithSpecificFlavorTestJSON-207981500 tempest-ServersWithSpecificFlavorTestJSON-207981500-project-member] Filtering removed all hosts for the request with instance ID '395d134b-079c-4191-8fd7-48fd8cec163c'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 544.447408] nova-scheduler[51961]: INFO nova.filters [None req-c2296365-a38c-42ca-ab1d-660922a68cc3 tempest-ServersWithSpecificFlavorTestJSON-207981500 tempest-ServersWithSpecificFlavorTestJSON-207981500-project-member] Filtering removed all hosts for the request with instance ID '395d134b-079c-4191-8fd7-48fd8cec163c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 544.447558] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-c2296365-a38c-42ca-ab1d-660922a68cc3 tempest-ServersWithSpecificFlavorTestJSON-207981500 tempest-ServersWithSpecificFlavorTestJSON-207981500-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 544.447707] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-c2296365-a38c-42ca-ab1d-660922a68cc3 tempest-ServersWithSpecificFlavorTestJSON-207981500 tempest-ServersWithSpecificFlavorTestJSON-207981500-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 547.833011] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-927d6fb4-d4f5-469c-9198-e2f5818c01e6 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Starting to schedule for instances: ['6145ade8-736b-4ad4-9988-d9a021308ecc'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 547.833506] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-927d6fb4-d4f5-469c-9198-e2f5818c01e6 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 547.833506] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-927d6fb4-d4f5-469c-9198-e2f5818c01e6 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 547.833688] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-927d6fb4-d4f5-469c-9198-e2f5818c01e6 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 547.834167] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-927d6fb4-d4f5-469c-9198-e2f5818c01e6 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 547.834791] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-927d6fb4-d4f5-469c-9198-e2f5818c01e6 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 547.894753] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-927d6fb4-d4f5-469c-9198-e2f5818c01e6 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 547.894978] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-927d6fb4-d4f5-469c-9198-e2f5818c01e6 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 547.895167] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-927d6fb4-d4f5-469c-9198-e2f5818c01e6 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 547.905317] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-927d6fb4-d4f5-469c-9198-e2f5818c01e6 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 547.905317] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-927d6fb4-d4f5-469c-9198-e2f5818c01e6 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 547.905476] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-927d6fb4-d4f5-469c-9198-e2f5818c01e6 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 547.907998] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-927d6fb4-d4f5-469c-9198-e2f5818c01e6 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 547.908252] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-927d6fb4-d4f5-469c-9198-e2f5818c01e6 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 547.908594] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-927d6fb4-d4f5-469c-9198-e2f5818c01e6 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='1',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:02:25Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 547.909157] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-927d6fb4-d4f5-469c-9198-e2f5818c01e6 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 547.909157] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-927d6fb4-d4f5-469c-9198-e2f5818c01e6 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 547.909300] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-927d6fb4-d4f5-469c-9198-e2f5818c01e6 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'a93c0169-490e-4cd2-b890-5e1d8aecae59', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 547.909419] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-927d6fb4-d4f5-469c-9198-e2f5818c01e6 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 547.909675] nova-scheduler[51959]: DEBUG nova.filters [None req-927d6fb4-d4f5-469c-9198-e2f5818c01e6 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 547.909886] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-927d6fb4-d4f5-469c-9198-e2f5818c01e6 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 73.77213 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 547.910286] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-927d6fb4-d4f5-469c-9198-e2f5818c01e6 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 547.910286] nova-scheduler[51959]: INFO nova.filters [None req-927d6fb4-d4f5-469c-9198-e2f5818c01e6 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Filter ComputeFilter returned 0 hosts [ 547.910452] nova-scheduler[51959]: DEBUG nova.filters [None req-927d6fb4-d4f5-469c-9198-e2f5818c01e6 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Filtering removed all hosts for the request with instance ID '6145ade8-736b-4ad4-9988-d9a021308ecc'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 547.910504] nova-scheduler[51959]: INFO nova.filters [None req-927d6fb4-d4f5-469c-9198-e2f5818c01e6 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Filtering removed all hosts for the request with instance ID '6145ade8-736b-4ad4-9988-d9a021308ecc'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 547.910652] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-927d6fb4-d4f5-469c-9198-e2f5818c01e6 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 547.910832] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-927d6fb4-d4f5-469c-9198-e2f5818c01e6 tempest-VolumesAdminNegativeTest-875907274 tempest-VolumesAdminNegativeTest-875907274-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 547.929368] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-4e9ac174-8f7d-4a10-b294-b73a62f52148 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Starting to schedule for instances: ['a9a45897-e8de-4d6a-a42f-ce83d7f478ba'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 547.929368] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-4e9ac174-8f7d-4a10-b294-b73a62f52148 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 547.929368] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-4e9ac174-8f7d-4a10-b294-b73a62f52148 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 547.933694] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-4e9ac174-8f7d-4a10-b294-b73a62f52148 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 547.933694] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-4e9ac174-8f7d-4a10-b294-b73a62f52148 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 547.933694] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-4e9ac174-8f7d-4a10-b294-b73a62f52148 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 548.023981] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-4e9ac174-8f7d-4a10-b294-b73a62f52148 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 548.023981] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-4e9ac174-8f7d-4a10-b294-b73a62f52148 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 548.023981] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-4e9ac174-8f7d-4a10-b294-b73a62f52148 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 548.031747] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-4e9ac174-8f7d-4a10-b294-b73a62f52148 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 548.032423] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-4e9ac174-8f7d-4a10-b294-b73a62f52148 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 548.032423] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-4e9ac174-8f7d-4a10-b294-b73a62f52148 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 548.034602] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-4e9ac174-8f7d-4a10-b294-b73a62f52148 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 548.038631] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-4e9ac174-8f7d-4a10-b294-b73a62f52148 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 548.038777] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-4e9ac174-8f7d-4a10-b294-b73a62f52148 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='1',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:02:25Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 548.041021] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-4e9ac174-8f7d-4a10-b294-b73a62f52148 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 548.041021] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-4e9ac174-8f7d-4a10-b294-b73a62f52148 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 548.041021] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-4e9ac174-8f7d-4a10-b294-b73a62f52148 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'a93c0169-490e-4cd2-b890-5e1d8aecae59', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 548.041021] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-4e9ac174-8f7d-4a10-b294-b73a62f52148 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.005s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 548.041021] nova-scheduler[51961]: DEBUG nova.filters [None req-4e9ac174-8f7d-4a10-b294-b73a62f52148 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 548.041021] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-4e9ac174-8f7d-4a10-b294-b73a62f52148 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 73.902233 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 548.041021] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-4e9ac174-8f7d-4a10-b294-b73a62f52148 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 548.041021] nova-scheduler[51961]: INFO nova.filters [None req-4e9ac174-8f7d-4a10-b294-b73a62f52148 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Filter ComputeFilter returned 0 hosts [ 548.041021] nova-scheduler[51961]: DEBUG nova.filters [None req-4e9ac174-8f7d-4a10-b294-b73a62f52148 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Filtering removed all hosts for the request with instance ID 'a9a45897-e8de-4d6a-a42f-ce83d7f478ba'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 548.041021] nova-scheduler[51961]: INFO nova.filters [None req-4e9ac174-8f7d-4a10-b294-b73a62f52148 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Filtering removed all hosts for the request with instance ID 'a9a45897-e8de-4d6a-a42f-ce83d7f478ba'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 548.041021] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-4e9ac174-8f7d-4a10-b294-b73a62f52148 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 548.041882] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-4e9ac174-8f7d-4a10-b294-b73a62f52148 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 552.311114] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-a354b68b-89ab-4643-9198-fccff9e1749d tempest-ServersTestBootFromVolume-1166592086 tempest-ServersTestBootFromVolume-1166592086-project-member] Starting to schedule for instances: ['03e064b3-75c7-4eba-8eb9-3d8cc21f7ac8'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 552.311114] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-a354b68b-89ab-4643-9198-fccff9e1749d tempest-ServersTestBootFromVolume-1166592086 tempest-ServersTestBootFromVolume-1166592086-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 552.311114] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-a354b68b-89ab-4643-9198-fccff9e1749d tempest-ServersTestBootFromVolume-1166592086 tempest-ServersTestBootFromVolume-1166592086-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 552.311114] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-a354b68b-89ab-4643-9198-fccff9e1749d tempest-ServersTestBootFromVolume-1166592086 tempest-ServersTestBootFromVolume-1166592086-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 552.311114] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-a354b68b-89ab-4643-9198-fccff9e1749d tempest-ServersTestBootFromVolume-1166592086 tempest-ServersTestBootFromVolume-1166592086-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 552.311114] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-a354b68b-89ab-4643-9198-fccff9e1749d tempest-ServersTestBootFromVolume-1166592086 tempest-ServersTestBootFromVolume-1166592086-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 552.354326] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a354b68b-89ab-4643-9198-fccff9e1749d tempest-ServersTestBootFromVolume-1166592086 tempest-ServersTestBootFromVolume-1166592086-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 552.354326] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a354b68b-89ab-4643-9198-fccff9e1749d tempest-ServersTestBootFromVolume-1166592086 tempest-ServersTestBootFromVolume-1166592086-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 552.354326] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a354b68b-89ab-4643-9198-fccff9e1749d tempest-ServersTestBootFromVolume-1166592086 tempest-ServersTestBootFromVolume-1166592086-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 552.362360] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a354b68b-89ab-4643-9198-fccff9e1749d tempest-ServersTestBootFromVolume-1166592086 tempest-ServersTestBootFromVolume-1166592086-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 552.362727] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a354b68b-89ab-4643-9198-fccff9e1749d tempest-ServersTestBootFromVolume-1166592086 tempest-ServersTestBootFromVolume-1166592086-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 552.363107] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a354b68b-89ab-4643-9198-fccff9e1749d tempest-ServersTestBootFromVolume-1166592086 tempest-ServersTestBootFromVolume-1166592086-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 552.366571] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a354b68b-89ab-4643-9198-fccff9e1749d tempest-ServersTestBootFromVolume-1166592086 tempest-ServersTestBootFromVolume-1166592086-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 552.366706] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a354b68b-89ab-4643-9198-fccff9e1749d tempest-ServersTestBootFromVolume-1166592086 tempest-ServersTestBootFromVolume-1166592086-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 552.367105] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-a354b68b-89ab-4643-9198-fccff9e1749d tempest-ServersTestBootFromVolume-1166592086 tempest-ServersTestBootFromVolume-1166592086-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='1',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:02:25Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 552.367535] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-a354b68b-89ab-4643-9198-fccff9e1749d tempest-ServersTestBootFromVolume-1166592086 tempest-ServersTestBootFromVolume-1166592086-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 552.367637] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-a354b68b-89ab-4643-9198-fccff9e1749d tempest-ServersTestBootFromVolume-1166592086 tempest-ServersTestBootFromVolume-1166592086-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 552.367749] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-a354b68b-89ab-4643-9198-fccff9e1749d tempest-ServersTestBootFromVolume-1166592086 tempest-ServersTestBootFromVolume-1166592086-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'a93c0169-490e-4cd2-b890-5e1d8aecae59', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 552.367904] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a354b68b-89ab-4643-9198-fccff9e1749d tempest-ServersTestBootFromVolume-1166592086 tempest-ServersTestBootFromVolume-1166592086-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 552.368195] nova-scheduler[51959]: DEBUG nova.filters [None req-a354b68b-89ab-4643-9198-fccff9e1749d tempest-ServersTestBootFromVolume-1166592086 tempest-ServersTestBootFromVolume-1166592086-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 552.368408] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-a354b68b-89ab-4643-9198-fccff9e1749d tempest-ServersTestBootFromVolume-1166592086 tempest-ServersTestBootFromVolume-1166592086-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 78.230649 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 552.368589] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-a354b68b-89ab-4643-9198-fccff9e1749d tempest-ServersTestBootFromVolume-1166592086 tempest-ServersTestBootFromVolume-1166592086-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 552.369241] nova-scheduler[51959]: INFO nova.filters [None req-a354b68b-89ab-4643-9198-fccff9e1749d tempest-ServersTestBootFromVolume-1166592086 tempest-ServersTestBootFromVolume-1166592086-project-member] Filter ComputeFilter returned 0 hosts [ 552.369396] nova-scheduler[51959]: DEBUG nova.filters [None req-a354b68b-89ab-4643-9198-fccff9e1749d tempest-ServersTestBootFromVolume-1166592086 tempest-ServersTestBootFromVolume-1166592086-project-member] Filtering removed all hosts for the request with instance ID '03e064b3-75c7-4eba-8eb9-3d8cc21f7ac8'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 552.369549] nova-scheduler[51959]: INFO nova.filters [None req-a354b68b-89ab-4643-9198-fccff9e1749d tempest-ServersTestBootFromVolume-1166592086 tempest-ServersTestBootFromVolume-1166592086-project-member] Filtering removed all hosts for the request with instance ID '03e064b3-75c7-4eba-8eb9-3d8cc21f7ac8'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 552.369704] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-a354b68b-89ab-4643-9198-fccff9e1749d tempest-ServersTestBootFromVolume-1166592086 tempest-ServersTestBootFromVolume-1166592086-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 552.369855] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-a354b68b-89ab-4643-9198-fccff9e1749d tempest-ServersTestBootFromVolume-1166592086 tempest-ServersTestBootFromVolume-1166592086-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 560.589785] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-a2defa33-7f5d-46a6-9d91-348f73f4ee54 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Starting to schedule for instances: ['49544334-4e4a-47d5-a164-5354b7493b88'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 560.589785] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-a2defa33-7f5d-46a6-9d91-348f73f4ee54 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 560.589785] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-a2defa33-7f5d-46a6-9d91-348f73f4ee54 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 560.590332] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-a2defa33-7f5d-46a6-9d91-348f73f4ee54 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 560.590714] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-a2defa33-7f5d-46a6-9d91-348f73f4ee54 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 560.591393] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-a2defa33-7f5d-46a6-9d91-348f73f4ee54 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 560.644783] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-a2defa33-7f5d-46a6-9d91-348f73f4ee54 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 560.645122] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-a2defa33-7f5d-46a6-9d91-348f73f4ee54 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 560.645223] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-a2defa33-7f5d-46a6-9d91-348f73f4ee54 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 560.654684] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-a2defa33-7f5d-46a6-9d91-348f73f4ee54 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 560.654831] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-a2defa33-7f5d-46a6-9d91-348f73f4ee54 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 560.654975] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-a2defa33-7f5d-46a6-9d91-348f73f4ee54 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 560.657567] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-a2defa33-7f5d-46a6-9d91-348f73f4ee54 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 560.657784] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-a2defa33-7f5d-46a6-9d91-348f73f4ee54 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 560.659234] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-a2defa33-7f5d-46a6-9d91-348f73f4ee54 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='1',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:02:25Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 560.659234] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-a2defa33-7f5d-46a6-9d91-348f73f4ee54 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 560.659234] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-a2defa33-7f5d-46a6-9d91-348f73f4ee54 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 560.659234] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-a2defa33-7f5d-46a6-9d91-348f73f4ee54 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'a93c0169-490e-4cd2-b890-5e1d8aecae59', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 560.660247] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-a2defa33-7f5d-46a6-9d91-348f73f4ee54 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 560.660247] nova-scheduler[51961]: DEBUG nova.filters [None req-a2defa33-7f5d-46a6-9d91-348f73f4ee54 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 560.660247] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-a2defa33-7f5d-46a6-9d91-348f73f4ee54 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 86.52205 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 560.661220] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-a2defa33-7f5d-46a6-9d91-348f73f4ee54 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 560.662111] nova-scheduler[51961]: INFO nova.filters [None req-a2defa33-7f5d-46a6-9d91-348f73f4ee54 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Filter ComputeFilter returned 0 hosts [ 560.662111] nova-scheduler[51961]: DEBUG nova.filters [None req-a2defa33-7f5d-46a6-9d91-348f73f4ee54 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Filtering removed all hosts for the request with instance ID '49544334-4e4a-47d5-a164-5354b7493b88'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 560.662188] nova-scheduler[51961]: INFO nova.filters [None req-a2defa33-7f5d-46a6-9d91-348f73f4ee54 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Filtering removed all hosts for the request with instance ID '49544334-4e4a-47d5-a164-5354b7493b88'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 560.662306] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-a2defa33-7f5d-46a6-9d91-348f73f4ee54 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 560.662468] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-a2defa33-7f5d-46a6-9d91-348f73f4ee54 tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 564.294723] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-92d21b6c-f8fa-46b9-b1d9-0d5c34d01aa0 tempest-ListServersNegativeTestJSON-593946779 tempest-ListServersNegativeTestJSON-593946779-project-member] Starting to schedule for instances: ['0bd301f2-9c59-472c-bc86-e57612f1f991', 'f7a62d62-d66d-450c-a003-b6a89e9894f4', 'b8d11415-26fc-4329-8e86-7772a0cd8f4d'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 564.301032] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-92d21b6c-f8fa-46b9-b1d9-0d5c34d01aa0 tempest-ListServersNegativeTestJSON-593946779 tempest-ListServersNegativeTestJSON-593946779-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 564.301032] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-92d21b6c-f8fa-46b9-b1d9-0d5c34d01aa0 tempest-ListServersNegativeTestJSON-593946779 tempest-ListServersNegativeTestJSON-593946779-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 564.301032] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-92d21b6c-f8fa-46b9-b1d9-0d5c34d01aa0 tempest-ListServersNegativeTestJSON-593946779 tempest-ListServersNegativeTestJSON-593946779-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 564.301032] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-92d21b6c-f8fa-46b9-b1d9-0d5c34d01aa0 tempest-ListServersNegativeTestJSON-593946779 tempest-ListServersNegativeTestJSON-593946779-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 564.301032] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-92d21b6c-f8fa-46b9-b1d9-0d5c34d01aa0 tempest-ListServersNegativeTestJSON-593946779 tempest-ListServersNegativeTestJSON-593946779-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 564.350105] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-92d21b6c-f8fa-46b9-b1d9-0d5c34d01aa0 tempest-ListServersNegativeTestJSON-593946779 tempest-ListServersNegativeTestJSON-593946779-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 564.350105] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-92d21b6c-f8fa-46b9-b1d9-0d5c34d01aa0 tempest-ListServersNegativeTestJSON-593946779 tempest-ListServersNegativeTestJSON-593946779-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 564.350105] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-92d21b6c-f8fa-46b9-b1d9-0d5c34d01aa0 tempest-ListServersNegativeTestJSON-593946779 tempest-ListServersNegativeTestJSON-593946779-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 564.358307] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-92d21b6c-f8fa-46b9-b1d9-0d5c34d01aa0 tempest-ListServersNegativeTestJSON-593946779 tempest-ListServersNegativeTestJSON-593946779-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 564.358307] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-92d21b6c-f8fa-46b9-b1d9-0d5c34d01aa0 tempest-ListServersNegativeTestJSON-593946779 tempest-ListServersNegativeTestJSON-593946779-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 564.358307] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-92d21b6c-f8fa-46b9-b1d9-0d5c34d01aa0 tempest-ListServersNegativeTestJSON-593946779 tempest-ListServersNegativeTestJSON-593946779-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 564.361075] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-92d21b6c-f8fa-46b9-b1d9-0d5c34d01aa0 tempest-ListServersNegativeTestJSON-593946779 tempest-ListServersNegativeTestJSON-593946779-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 564.361565] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-92d21b6c-f8fa-46b9-b1d9-0d5c34d01aa0 tempest-ListServersNegativeTestJSON-593946779 tempest-ListServersNegativeTestJSON-593946779-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 564.363123] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-92d21b6c-f8fa-46b9-b1d9-0d5c34d01aa0 tempest-ListServersNegativeTestJSON-593946779 tempest-ListServersNegativeTestJSON-593946779-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='1',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:02:25Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 564.363123] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-92d21b6c-f8fa-46b9-b1d9-0d5c34d01aa0 tempest-ListServersNegativeTestJSON-593946779 tempest-ListServersNegativeTestJSON-593946779-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 564.363123] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-92d21b6c-f8fa-46b9-b1d9-0d5c34d01aa0 tempest-ListServersNegativeTestJSON-593946779 tempest-ListServersNegativeTestJSON-593946779-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 564.363123] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-92d21b6c-f8fa-46b9-b1d9-0d5c34d01aa0 tempest-ListServersNegativeTestJSON-593946779 tempest-ListServersNegativeTestJSON-593946779-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'a93c0169-490e-4cd2-b890-5e1d8aecae59', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 564.363123] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-92d21b6c-f8fa-46b9-b1d9-0d5c34d01aa0 tempest-ListServersNegativeTestJSON-593946779 tempest-ListServersNegativeTestJSON-593946779-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 564.363768] nova-scheduler[51959]: DEBUG nova.filters [None req-92d21b6c-f8fa-46b9-b1d9-0d5c34d01aa0 tempest-ListServersNegativeTestJSON-593946779 tempest-ListServersNegativeTestJSON-593946779-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 564.364236] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-92d21b6c-f8fa-46b9-b1d9-0d5c34d01aa0 tempest-ListServersNegativeTestJSON-593946779 tempest-ListServersNegativeTestJSON-593946779-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 90.226432 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 564.366217] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-92d21b6c-f8fa-46b9-b1d9-0d5c34d01aa0 tempest-ListServersNegativeTestJSON-593946779 tempest-ListServersNegativeTestJSON-593946779-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 564.366217] nova-scheduler[51959]: INFO nova.filters [None req-92d21b6c-f8fa-46b9-b1d9-0d5c34d01aa0 tempest-ListServersNegativeTestJSON-593946779 tempest-ListServersNegativeTestJSON-593946779-project-member] Filter ComputeFilter returned 0 hosts [ 564.366217] nova-scheduler[51959]: DEBUG nova.filters [None req-92d21b6c-f8fa-46b9-b1d9-0d5c34d01aa0 tempest-ListServersNegativeTestJSON-593946779 tempest-ListServersNegativeTestJSON-593946779-project-member] Filtering removed all hosts for the request with instance ID '0bd301f2-9c59-472c-bc86-e57612f1f991'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 564.366217] nova-scheduler[51959]: INFO nova.filters [None req-92d21b6c-f8fa-46b9-b1d9-0d5c34d01aa0 tempest-ListServersNegativeTestJSON-593946779 tempest-ListServersNegativeTestJSON-593946779-project-member] Filtering removed all hosts for the request with instance ID '0bd301f2-9c59-472c-bc86-e57612f1f991'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 564.366217] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-92d21b6c-f8fa-46b9-b1d9-0d5c34d01aa0 tempest-ListServersNegativeTestJSON-593946779 tempest-ListServersNegativeTestJSON-593946779-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 564.366217] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-92d21b6c-f8fa-46b9-b1d9-0d5c34d01aa0 tempest-ListServersNegativeTestJSON-593946779 tempest-ListServersNegativeTestJSON-593946779-project-member] There are 0 hosts available but 3 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 564.809240] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-74e0bc35-0f28-453b-a023-1c16d936bc57 tempest-ServersAaction247Test-2075506948 tempest-ServersAaction247Test-2075506948-project-member] Starting to schedule for instances: ['63ee2c7d-1fb0-4972-bb42-0d050dcb98a8'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 564.809959] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-74e0bc35-0f28-453b-a023-1c16d936bc57 tempest-ServersAaction247Test-2075506948 tempest-ServersAaction247Test-2075506948-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 564.811779] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-74e0bc35-0f28-453b-a023-1c16d936bc57 tempest-ServersAaction247Test-2075506948 tempest-ServersAaction247Test-2075506948-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 564.811779] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-74e0bc35-0f28-453b-a023-1c16d936bc57 tempest-ServersAaction247Test-2075506948 tempest-ServersAaction247Test-2075506948-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 564.811779] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-74e0bc35-0f28-453b-a023-1c16d936bc57 tempest-ServersAaction247Test-2075506948 tempest-ServersAaction247Test-2075506948-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 564.811779] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-74e0bc35-0f28-453b-a023-1c16d936bc57 tempest-ServersAaction247Test-2075506948 tempest-ServersAaction247Test-2075506948-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 564.868502] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-74e0bc35-0f28-453b-a023-1c16d936bc57 tempest-ServersAaction247Test-2075506948 tempest-ServersAaction247Test-2075506948-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 564.870972] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-74e0bc35-0f28-453b-a023-1c16d936bc57 tempest-ServersAaction247Test-2075506948 tempest-ServersAaction247Test-2075506948-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 564.870972] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-74e0bc35-0f28-453b-a023-1c16d936bc57 tempest-ServersAaction247Test-2075506948 tempest-ServersAaction247Test-2075506948-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 564.888704] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-74e0bc35-0f28-453b-a023-1c16d936bc57 tempest-ServersAaction247Test-2075506948 tempest-ServersAaction247Test-2075506948-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 564.889063] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-74e0bc35-0f28-453b-a023-1c16d936bc57 tempest-ServersAaction247Test-2075506948 tempest-ServersAaction247Test-2075506948-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 564.889280] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-74e0bc35-0f28-453b-a023-1c16d936bc57 tempest-ServersAaction247Test-2075506948 tempest-ServersAaction247Test-2075506948-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 564.894559] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-74e0bc35-0f28-453b-a023-1c16d936bc57 tempest-ServersAaction247Test-2075506948 tempest-ServersAaction247Test-2075506948-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 564.898374] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-74e0bc35-0f28-453b-a023-1c16d936bc57 tempest-ServersAaction247Test-2075506948 tempest-ServersAaction247Test-2075506948-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 564.898374] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-74e0bc35-0f28-453b-a023-1c16d936bc57 tempest-ServersAaction247Test-2075506948 tempest-ServersAaction247Test-2075506948-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='1',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:02:25Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 564.898374] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-74e0bc35-0f28-453b-a023-1c16d936bc57 tempest-ServersAaction247Test-2075506948 tempest-ServersAaction247Test-2075506948-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 564.898374] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-74e0bc35-0f28-453b-a023-1c16d936bc57 tempest-ServersAaction247Test-2075506948 tempest-ServersAaction247Test-2075506948-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 564.898374] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-74e0bc35-0f28-453b-a023-1c16d936bc57 tempest-ServersAaction247Test-2075506948 tempest-ServersAaction247Test-2075506948-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'a93c0169-490e-4cd2-b890-5e1d8aecae59', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 564.898374] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-74e0bc35-0f28-453b-a023-1c16d936bc57 tempest-ServersAaction247Test-2075506948 tempest-ServersAaction247Test-2075506948-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 564.898374] nova-scheduler[51961]: DEBUG nova.filters [None req-74e0bc35-0f28-453b-a023-1c16d936bc57 tempest-ServersAaction247Test-2075506948 tempest-ServersAaction247Test-2075506948-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 564.899142] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-74e0bc35-0f28-453b-a023-1c16d936bc57 tempest-ServersAaction247Test-2075506948 tempest-ServersAaction247Test-2075506948-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 90.759358 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 564.899142] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-74e0bc35-0f28-453b-a023-1c16d936bc57 tempest-ServersAaction247Test-2075506948 tempest-ServersAaction247Test-2075506948-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 564.899142] nova-scheduler[51961]: INFO nova.filters [None req-74e0bc35-0f28-453b-a023-1c16d936bc57 tempest-ServersAaction247Test-2075506948 tempest-ServersAaction247Test-2075506948-project-member] Filter ComputeFilter returned 0 hosts [ 564.899142] nova-scheduler[51961]: DEBUG nova.filters [None req-74e0bc35-0f28-453b-a023-1c16d936bc57 tempest-ServersAaction247Test-2075506948 tempest-ServersAaction247Test-2075506948-project-member] Filtering removed all hosts for the request with instance ID '63ee2c7d-1fb0-4972-bb42-0d050dcb98a8'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 564.899142] nova-scheduler[51961]: INFO nova.filters [None req-74e0bc35-0f28-453b-a023-1c16d936bc57 tempest-ServersAaction247Test-2075506948 tempest-ServersAaction247Test-2075506948-project-member] Filtering removed all hosts for the request with instance ID '63ee2c7d-1fb0-4972-bb42-0d050dcb98a8'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 564.899142] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-74e0bc35-0f28-453b-a023-1c16d936bc57 tempest-ServersAaction247Test-2075506948 tempest-ServersAaction247Test-2075506948-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 564.899142] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-74e0bc35-0f28-453b-a023-1c16d936bc57 tempest-ServersAaction247Test-2075506948 tempest-ServersAaction247Test-2075506948-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 566.078163] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-983cf994-ecfe-455a-9392-30b85cab9cd7 tempest-ServersTestManualDisk-1963154159 tempest-ServersTestManualDisk-1963154159-project-member] Starting to schedule for instances: ['4d275bfc-79b1-43fe-bdbf-553201764aae'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 566.078493] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-983cf994-ecfe-455a-9392-30b85cab9cd7 tempest-ServersTestManualDisk-1963154159 tempest-ServersTestManualDisk-1963154159-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 566.078731] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-983cf994-ecfe-455a-9392-30b85cab9cd7 tempest-ServersTestManualDisk-1963154159 tempest-ServersTestManualDisk-1963154159-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 566.078840] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-983cf994-ecfe-455a-9392-30b85cab9cd7 tempest-ServersTestManualDisk-1963154159 tempest-ServersTestManualDisk-1963154159-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 566.079091] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-983cf994-ecfe-455a-9392-30b85cab9cd7 tempest-ServersTestManualDisk-1963154159 tempest-ServersTestManualDisk-1963154159-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 566.079306] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-983cf994-ecfe-455a-9392-30b85cab9cd7 tempest-ServersTestManualDisk-1963154159 tempest-ServersTestManualDisk-1963154159-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 566.139864] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-983cf994-ecfe-455a-9392-30b85cab9cd7 tempest-ServersTestManualDisk-1963154159 tempest-ServersTestManualDisk-1963154159-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 566.140411] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-983cf994-ecfe-455a-9392-30b85cab9cd7 tempest-ServersTestManualDisk-1963154159 tempest-ServersTestManualDisk-1963154159-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 566.140651] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-983cf994-ecfe-455a-9392-30b85cab9cd7 tempest-ServersTestManualDisk-1963154159 tempest-ServersTestManualDisk-1963154159-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 566.147612] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-983cf994-ecfe-455a-9392-30b85cab9cd7 tempest-ServersTestManualDisk-1963154159 tempest-ServersTestManualDisk-1963154159-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 566.147831] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-983cf994-ecfe-455a-9392-30b85cab9cd7 tempest-ServersTestManualDisk-1963154159 tempest-ServersTestManualDisk-1963154159-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 566.148196] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-983cf994-ecfe-455a-9392-30b85cab9cd7 tempest-ServersTestManualDisk-1963154159 tempest-ServersTestManualDisk-1963154159-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 566.150280] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-983cf994-ecfe-455a-9392-30b85cab9cd7 tempest-ServersTestManualDisk-1963154159 tempest-ServersTestManualDisk-1963154159-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 566.151173] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-983cf994-ecfe-455a-9392-30b85cab9cd7 tempest-ServersTestManualDisk-1963154159 tempest-ServersTestManualDisk-1963154159-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 566.151173] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-983cf994-ecfe-455a-9392-30b85cab9cd7 tempest-ServersTestManualDisk-1963154159 tempest-ServersTestManualDisk-1963154159-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='1',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:02:25Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 566.151173] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-983cf994-ecfe-455a-9392-30b85cab9cd7 tempest-ServersTestManualDisk-1963154159 tempest-ServersTestManualDisk-1963154159-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 566.151420] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-983cf994-ecfe-455a-9392-30b85cab9cd7 tempest-ServersTestManualDisk-1963154159 tempest-ServersTestManualDisk-1963154159-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 566.154027] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-983cf994-ecfe-455a-9392-30b85cab9cd7 tempest-ServersTestManualDisk-1963154159 tempest-ServersTestManualDisk-1963154159-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'a93c0169-490e-4cd2-b890-5e1d8aecae59', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 566.154027] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-983cf994-ecfe-455a-9392-30b85cab9cd7 tempest-ServersTestManualDisk-1963154159 tempest-ServersTestManualDisk-1963154159-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 566.154027] nova-scheduler[51959]: DEBUG nova.filters [None req-983cf994-ecfe-455a-9392-30b85cab9cd7 tempest-ServersTestManualDisk-1963154159 tempest-ServersTestManualDisk-1963154159-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 566.154027] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-983cf994-ecfe-455a-9392-30b85cab9cd7 tempest-ServersTestManualDisk-1963154159 tempest-ServersTestManualDisk-1963154159-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 92.014367 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 566.154027] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-983cf994-ecfe-455a-9392-30b85cab9cd7 tempest-ServersTestManualDisk-1963154159 tempest-ServersTestManualDisk-1963154159-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 566.154027] nova-scheduler[51959]: INFO nova.filters [None req-983cf994-ecfe-455a-9392-30b85cab9cd7 tempest-ServersTestManualDisk-1963154159 tempest-ServersTestManualDisk-1963154159-project-member] Filter ComputeFilter returned 0 hosts [ 566.154027] nova-scheduler[51959]: DEBUG nova.filters [None req-983cf994-ecfe-455a-9392-30b85cab9cd7 tempest-ServersTestManualDisk-1963154159 tempest-ServersTestManualDisk-1963154159-project-member] Filtering removed all hosts for the request with instance ID '4d275bfc-79b1-43fe-bdbf-553201764aae'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 566.154027] nova-scheduler[51959]: INFO nova.filters [None req-983cf994-ecfe-455a-9392-30b85cab9cd7 tempest-ServersTestManualDisk-1963154159 tempest-ServersTestManualDisk-1963154159-project-member] Filtering removed all hosts for the request with instance ID '4d275bfc-79b1-43fe-bdbf-553201764aae'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 566.154027] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-983cf994-ecfe-455a-9392-30b85cab9cd7 tempest-ServersTestManualDisk-1963154159 tempest-ServersTestManualDisk-1963154159-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 566.154027] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-983cf994-ecfe-455a-9392-30b85cab9cd7 tempest-ServersTestManualDisk-1963154159 tempest-ServersTestManualDisk-1963154159-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 568.472930] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-245886bd-5cee-4f01-b3e9-2635f023302c tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Starting to schedule for instances: ['1963b819-7560-46b8-b98e-617bb99f7bc2'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 568.472930] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-245886bd-5cee-4f01-b3e9-2635f023302c tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 568.472930] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-245886bd-5cee-4f01-b3e9-2635f023302c tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 568.472930] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-245886bd-5cee-4f01-b3e9-2635f023302c tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 568.472930] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-245886bd-5cee-4f01-b3e9-2635f023302c tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 568.473352] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-245886bd-5cee-4f01-b3e9-2635f023302c tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 568.532728] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-245886bd-5cee-4f01-b3e9-2635f023302c tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 568.533272] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-245886bd-5cee-4f01-b3e9-2635f023302c tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 568.533422] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-245886bd-5cee-4f01-b3e9-2635f023302c tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 568.543191] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-245886bd-5cee-4f01-b3e9-2635f023302c tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 568.543486] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-245886bd-5cee-4f01-b3e9-2635f023302c tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 568.543710] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-245886bd-5cee-4f01-b3e9-2635f023302c tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 568.546553] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-245886bd-5cee-4f01-b3e9-2635f023302c tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 568.546839] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-245886bd-5cee-4f01-b3e9-2635f023302c tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 568.547300] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-245886bd-5cee-4f01-b3e9-2635f023302c tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='1',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:02:25Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 568.548330] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-245886bd-5cee-4f01-b3e9-2635f023302c tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 568.548330] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-245886bd-5cee-4f01-b3e9-2635f023302c tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 568.548330] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-245886bd-5cee-4f01-b3e9-2635f023302c tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'a93c0169-490e-4cd2-b890-5e1d8aecae59', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 568.548330] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-245886bd-5cee-4f01-b3e9-2635f023302c tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 568.548678] nova-scheduler[51961]: DEBUG nova.filters [None req-245886bd-5cee-4f01-b3e9-2635f023302c tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 568.548838] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-245886bd-5cee-4f01-b3e9-2635f023302c tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 94.411027 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 568.549351] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-245886bd-5cee-4f01-b3e9-2635f023302c tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 568.549351] nova-scheduler[51961]: INFO nova.filters [None req-245886bd-5cee-4f01-b3e9-2635f023302c tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Filter ComputeFilter returned 0 hosts [ 568.549475] nova-scheduler[51961]: DEBUG nova.filters [None req-245886bd-5cee-4f01-b3e9-2635f023302c tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Filtering removed all hosts for the request with instance ID '1963b819-7560-46b8-b98e-617bb99f7bc2'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 568.549650] nova-scheduler[51961]: INFO nova.filters [None req-245886bd-5cee-4f01-b3e9-2635f023302c tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Filtering removed all hosts for the request with instance ID '1963b819-7560-46b8-b98e-617bb99f7bc2'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 568.549833] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-245886bd-5cee-4f01-b3e9-2635f023302c tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 568.550095] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-245886bd-5cee-4f01-b3e9-2635f023302c tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 570.757200] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-1d5a8c6b-ce43-4083-8e69-042171382e02 tempest-ServerPasswordTestJSON-909579219 tempest-ServerPasswordTestJSON-909579219-project-member] Starting to schedule for instances: ['81a9bbe4-aa7f-42b3-b14c-7c82123c46e2'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 570.758898] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-1d5a8c6b-ce43-4083-8e69-042171382e02 tempest-ServerPasswordTestJSON-909579219 tempest-ServerPasswordTestJSON-909579219-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 570.758898] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-1d5a8c6b-ce43-4083-8e69-042171382e02 tempest-ServerPasswordTestJSON-909579219 tempest-ServerPasswordTestJSON-909579219-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 570.758898] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-1d5a8c6b-ce43-4083-8e69-042171382e02 tempest-ServerPasswordTestJSON-909579219 tempest-ServerPasswordTestJSON-909579219-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 570.759046] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-1d5a8c6b-ce43-4083-8e69-042171382e02 tempest-ServerPasswordTestJSON-909579219 tempest-ServerPasswordTestJSON-909579219-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 570.759269] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-1d5a8c6b-ce43-4083-8e69-042171382e02 tempest-ServerPasswordTestJSON-909579219 tempest-ServerPasswordTestJSON-909579219-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 570.807227] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-1d5a8c6b-ce43-4083-8e69-042171382e02 tempest-ServerPasswordTestJSON-909579219 tempest-ServerPasswordTestJSON-909579219-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 570.808544] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-1d5a8c6b-ce43-4083-8e69-042171382e02 tempest-ServerPasswordTestJSON-909579219 tempest-ServerPasswordTestJSON-909579219-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 570.809341] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-1d5a8c6b-ce43-4083-8e69-042171382e02 tempest-ServerPasswordTestJSON-909579219 tempest-ServerPasswordTestJSON-909579219-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 570.816639] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-1d5a8c6b-ce43-4083-8e69-042171382e02 tempest-ServerPasswordTestJSON-909579219 tempest-ServerPasswordTestJSON-909579219-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 570.816858] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-1d5a8c6b-ce43-4083-8e69-042171382e02 tempest-ServerPasswordTestJSON-909579219 tempest-ServerPasswordTestJSON-909579219-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 570.817046] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-1d5a8c6b-ce43-4083-8e69-042171382e02 tempest-ServerPasswordTestJSON-909579219 tempest-ServerPasswordTestJSON-909579219-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 570.819803] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-1d5a8c6b-ce43-4083-8e69-042171382e02 tempest-ServerPasswordTestJSON-909579219 tempest-ServerPasswordTestJSON-909579219-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 570.820051] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-1d5a8c6b-ce43-4083-8e69-042171382e02 tempest-ServerPasswordTestJSON-909579219 tempest-ServerPasswordTestJSON-909579219-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 570.820391] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-1d5a8c6b-ce43-4083-8e69-042171382e02 tempest-ServerPasswordTestJSON-909579219 tempest-ServerPasswordTestJSON-909579219-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='1',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:02:25Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 570.820745] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-1d5a8c6b-ce43-4083-8e69-042171382e02 tempest-ServerPasswordTestJSON-909579219 tempest-ServerPasswordTestJSON-909579219-project-member] Update host state with aggregates: [Aggregate(created_at=2025-02-03T11:02:55Z,deleted=False,deleted_at=None,hosts=['cpu-1'],id=7,metadata={},name='tempest-test_aggregate-1041276249',updated_at=None,uuid=e5315cb2-c53b-44c0-ba69-1bdc86b8c48d)] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 570.820926] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-1d5a8c6b-ce43-4083-8e69-042171382e02 tempest-ServerPasswordTestJSON-909579219 tempest-ServerPasswordTestJSON-909579219-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 570.821108] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-1d5a8c6b-ce43-4083-8e69-042171382e02 tempest-ServerPasswordTestJSON-909579219 tempest-ServerPasswordTestJSON-909579219-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'a93c0169-490e-4cd2-b890-5e1d8aecae59', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 570.821310] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-1d5a8c6b-ce43-4083-8e69-042171382e02 tempest-ServerPasswordTestJSON-909579219 tempest-ServerPasswordTestJSON-909579219-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 570.821569] nova-scheduler[51959]: DEBUG nova.filters [None req-1d5a8c6b-ce43-4083-8e69-042171382e02 tempest-ServerPasswordTestJSON-909579219 tempest-ServerPasswordTestJSON-909579219-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 570.821778] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-1d5a8c6b-ce43-4083-8e69-042171382e02 tempest-ServerPasswordTestJSON-909579219 tempest-ServerPasswordTestJSON-909579219-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 96.684023 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 570.821942] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-1d5a8c6b-ce43-4083-8e69-042171382e02 tempest-ServerPasswordTestJSON-909579219 tempest-ServerPasswordTestJSON-909579219-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 570.822400] nova-scheduler[51959]: INFO nova.filters [None req-1d5a8c6b-ce43-4083-8e69-042171382e02 tempest-ServerPasswordTestJSON-909579219 tempest-ServerPasswordTestJSON-909579219-project-member] Filter ComputeFilter returned 0 hosts [ 570.822568] nova-scheduler[51959]: DEBUG nova.filters [None req-1d5a8c6b-ce43-4083-8e69-042171382e02 tempest-ServerPasswordTestJSON-909579219 tempest-ServerPasswordTestJSON-909579219-project-member] Filtering removed all hosts for the request with instance ID '81a9bbe4-aa7f-42b3-b14c-7c82123c46e2'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 570.822715] nova-scheduler[51959]: INFO nova.filters [None req-1d5a8c6b-ce43-4083-8e69-042171382e02 tempest-ServerPasswordTestJSON-909579219 tempest-ServerPasswordTestJSON-909579219-project-member] Filtering removed all hosts for the request with instance ID '81a9bbe4-aa7f-42b3-b14c-7c82123c46e2'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 570.822866] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-1d5a8c6b-ce43-4083-8e69-042171382e02 tempest-ServerPasswordTestJSON-909579219 tempest-ServerPasswordTestJSON-909579219-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 570.823041] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-1d5a8c6b-ce43-4083-8e69-042171382e02 tempest-ServerPasswordTestJSON-909579219 tempest-ServerPasswordTestJSON-909579219-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 572.450570] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-689faa1d-0f66-4c9e-a01a-27223e8b29b8 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Starting to schedule for instances: ['27929949-feed-4c23-b36a-7ffe9df6c5e5'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 572.451194] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-689faa1d-0f66-4c9e-a01a-27223e8b29b8 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 572.451432] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-689faa1d-0f66-4c9e-a01a-27223e8b29b8 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 572.451795] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-689faa1d-0f66-4c9e-a01a-27223e8b29b8 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 572.451968] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-689faa1d-0f66-4c9e-a01a-27223e8b29b8 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 572.452389] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-689faa1d-0f66-4c9e-a01a-27223e8b29b8 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 572.504766] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-689faa1d-0f66-4c9e-a01a-27223e8b29b8 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 572.505279] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-689faa1d-0f66-4c9e-a01a-27223e8b29b8 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 572.505279] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-689faa1d-0f66-4c9e-a01a-27223e8b29b8 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 572.513478] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-689faa1d-0f66-4c9e-a01a-27223e8b29b8 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 572.513862] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-689faa1d-0f66-4c9e-a01a-27223e8b29b8 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 572.513862] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-689faa1d-0f66-4c9e-a01a-27223e8b29b8 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 572.519200] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-689faa1d-0f66-4c9e-a01a-27223e8b29b8 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 572.519200] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-689faa1d-0f66-4c9e-a01a-27223e8b29b8 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 572.519200] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-689faa1d-0f66-4c9e-a01a-27223e8b29b8 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=6,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194926,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1664,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=9,service_id=None,stats={failed_builds='0',io_workload='9',num_instances='9',num_os_type_None='9',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='1',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='0',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='3',num_task_spawning='6',num_vm_building='9'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:03:02Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=9) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 572.519200] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-689faa1d-0f66-4c9e-a01a-27223e8b29b8 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state with aggregates: [Aggregate(created_at=2025-02-03T11:02:55Z,deleted=False,deleted_at=None,hosts=['cpu-1'],id=7,metadata={},name='tempest-test_aggregate-1041276249',updated_at=None,uuid=e5315cb2-c53b-44c0-ba69-1bdc86b8c48d)] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 572.519200] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-689faa1d-0f66-4c9e-a01a-27223e8b29b8 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 572.519200] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-689faa1d-0f66-4c9e-a01a-27223e8b29b8 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 572.519552] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-689faa1d-0f66-4c9e-a01a-27223e8b29b8 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 572.519552] nova-scheduler[51961]: DEBUG nova.filters [None req-689faa1d-0f66-4c9e-a01a-27223e8b29b8 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 572.519552] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-689faa1d-0f66-4c9e-a01a-27223e8b29b8 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 98.381108 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 572.519552] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-689faa1d-0f66-4c9e-a01a-27223e8b29b8 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 has not been heard from in a while [ 572.519552] nova-scheduler[51961]: INFO nova.filters [None req-689faa1d-0f66-4c9e-a01a-27223e8b29b8 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filter ComputeFilter returned 0 hosts [ 572.519552] nova-scheduler[51961]: DEBUG nova.filters [None req-689faa1d-0f66-4c9e-a01a-27223e8b29b8 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filtering removed all hosts for the request with instance ID '27929949-feed-4c23-b36a-7ffe9df6c5e5'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 572.519552] nova-scheduler[51961]: INFO nova.filters [None req-689faa1d-0f66-4c9e-a01a-27223e8b29b8 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filtering removed all hosts for the request with instance ID '27929949-feed-4c23-b36a-7ffe9df6c5e5'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 572.519821] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-689faa1d-0f66-4c9e-a01a-27223e8b29b8 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 572.519821] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-689faa1d-0f66-4c9e-a01a-27223e8b29b8 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 572.846499] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-b2acd679-2f79-4018-9bde-9d1a7c570973 tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Starting to schedule for instances: ['c0e77e55-50ed-4008-b075-c0424c3457a1'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 572.846698] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-b2acd679-2f79-4018-9bde-9d1a7c570973 tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 572.846903] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-b2acd679-2f79-4018-9bde-9d1a7c570973 tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 572.847181] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-b2acd679-2f79-4018-9bde-9d1a7c570973 tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 572.847430] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-b2acd679-2f79-4018-9bde-9d1a7c570973 tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 572.849845] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-b2acd679-2f79-4018-9bde-9d1a7c570973 tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 572.912687] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b2acd679-2f79-4018-9bde-9d1a7c570973 tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 572.912923] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b2acd679-2f79-4018-9bde-9d1a7c570973 tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 572.914182] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b2acd679-2f79-4018-9bde-9d1a7c570973 tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 572.924617] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b2acd679-2f79-4018-9bde-9d1a7c570973 tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 572.924841] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b2acd679-2f79-4018-9bde-9d1a7c570973 tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 572.925015] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b2acd679-2f79-4018-9bde-9d1a7c570973 tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 572.928832] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b2acd679-2f79-4018-9bde-9d1a7c570973 tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 572.929506] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b2acd679-2f79-4018-9bde-9d1a7c570973 tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 572.929716] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-b2acd679-2f79-4018-9bde-9d1a7c570973 tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=6,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='0',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='4',num_task_spawning='6',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:03:03Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 572.933136] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-b2acd679-2f79-4018-9bde-9d1a7c570973 tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Update host state with aggregates: [Aggregate(created_at=2025-02-03T11:02:55Z,deleted=False,deleted_at=None,hosts=['cpu-1'],id=7,metadata={},name='tempest-test_aggregate-1041276249',updated_at=None,uuid=e5315cb2-c53b-44c0-ba69-1bdc86b8c48d)] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 572.933371] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-b2acd679-2f79-4018-9bde-9d1a7c570973 tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 572.933553] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-b2acd679-2f79-4018-9bde-9d1a7c570973 tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 572.933747] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b2acd679-2f79-4018-9bde-9d1a7c570973 tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.005s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 572.934011] nova-scheduler[51959]: DEBUG nova.filters [None req-b2acd679-2f79-4018-9bde-9d1a7c570973 tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 572.934241] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-b2acd679-2f79-4018-9bde-9d1a7c570973 tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 98.796476 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 572.934406] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-b2acd679-2f79-4018-9bde-9d1a7c570973 tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 572.934567] nova-scheduler[51959]: INFO nova.filters [None req-b2acd679-2f79-4018-9bde-9d1a7c570973 tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Filter ComputeFilter returned 0 hosts [ 572.934756] nova-scheduler[51959]: DEBUG nova.filters [None req-b2acd679-2f79-4018-9bde-9d1a7c570973 tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Filtering removed all hosts for the request with instance ID 'c0e77e55-50ed-4008-b075-c0424c3457a1'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 572.934868] nova-scheduler[51959]: INFO nova.filters [None req-b2acd679-2f79-4018-9bde-9d1a7c570973 tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Filtering removed all hosts for the request with instance ID 'c0e77e55-50ed-4008-b075-c0424c3457a1'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 572.934998] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-b2acd679-2f79-4018-9bde-9d1a7c570973 tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 572.935217] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-b2acd679-2f79-4018-9bde-9d1a7c570973 tempest-ServersAdminTestJSON-1234628398 tempest-ServersAdminTestJSON-1234628398-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 576.943537] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-c7a07268-e271-453e-acfa-c49744d7e3ce tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Starting to schedule for instances: ['d917d1b2-1971-4adc-890c-9038972bc119'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 576.943537] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c7a07268-e271-453e-acfa-c49744d7e3ce tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 576.943537] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c7a07268-e271-453e-acfa-c49744d7e3ce tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 576.943537] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c7a07268-e271-453e-acfa-c49744d7e3ce tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 576.943865] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c7a07268-e271-453e-acfa-c49744d7e3ce tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 576.944062] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c7a07268-e271-453e-acfa-c49744d7e3ce tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 577.000762] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c7a07268-e271-453e-acfa-c49744d7e3ce tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 577.001759] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c7a07268-e271-453e-acfa-c49744d7e3ce tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 577.001759] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c7a07268-e271-453e-acfa-c49744d7e3ce tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 577.018042] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c7a07268-e271-453e-acfa-c49744d7e3ce tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 577.018305] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c7a07268-e271-453e-acfa-c49744d7e3ce tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 577.018482] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c7a07268-e271-453e-acfa-c49744d7e3ce tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 577.020889] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c7a07268-e271-453e-acfa-c49744d7e3ce tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 577.021116] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c7a07268-e271-453e-acfa-c49744d7e3ce tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 577.021651] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-c7a07268-e271-453e-acfa-c49744d7e3ce tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=6,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='0',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='4',num_task_spawning='6',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:03:03Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 577.021857] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-c7a07268-e271-453e-acfa-c49744d7e3ce tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 577.022111] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-c7a07268-e271-453e-acfa-c49744d7e3ce tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 577.022316] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-c7a07268-e271-453e-acfa-c49744d7e3ce tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 577.022393] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c7a07268-e271-453e-acfa-c49744d7e3ce tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 577.022645] nova-scheduler[51961]: DEBUG nova.filters [None req-c7a07268-e271-453e-acfa-c49744d7e3ce tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 577.022865] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-c7a07268-e271-453e-acfa-c49744d7e3ce tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 102.8851 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 577.023141] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-c7a07268-e271-453e-acfa-c49744d7e3ce tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 577.023217] nova-scheduler[51961]: INFO nova.filters [None req-c7a07268-e271-453e-acfa-c49744d7e3ce tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Filter ComputeFilter returned 0 hosts [ 577.023360] nova-scheduler[51961]: DEBUG nova.filters [None req-c7a07268-e271-453e-acfa-c49744d7e3ce tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Filtering removed all hosts for the request with instance ID 'd917d1b2-1971-4adc-890c-9038972bc119'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 577.023506] nova-scheduler[51961]: INFO nova.filters [None req-c7a07268-e271-453e-acfa-c49744d7e3ce tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Filtering removed all hosts for the request with instance ID 'd917d1b2-1971-4adc-890c-9038972bc119'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 577.023686] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-c7a07268-e271-453e-acfa-c49744d7e3ce tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 577.023961] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-c7a07268-e271-453e-acfa-c49744d7e3ce tempest-ImagesTestJSON-1412812746 tempest-ImagesTestJSON-1412812746-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 578.423406] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-1431f013-cf4f-4b3f-a0f8-ce39b5d567d2 tempest-ServersTestFqdnHostnames-795084039 tempest-ServersTestFqdnHostnames-795084039-project-member] Starting to schedule for instances: ['9c8a34dd-510f-45c6-b748-f441f21e0b70'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 578.423718] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-1431f013-cf4f-4b3f-a0f8-ce39b5d567d2 tempest-ServersTestFqdnHostnames-795084039 tempest-ServersTestFqdnHostnames-795084039-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 578.423884] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-1431f013-cf4f-4b3f-a0f8-ce39b5d567d2 tempest-ServersTestFqdnHostnames-795084039 tempest-ServersTestFqdnHostnames-795084039-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 578.424186] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-1431f013-cf4f-4b3f-a0f8-ce39b5d567d2 tempest-ServersTestFqdnHostnames-795084039 tempest-ServersTestFqdnHostnames-795084039-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 578.424437] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-1431f013-cf4f-4b3f-a0f8-ce39b5d567d2 tempest-ServersTestFqdnHostnames-795084039 tempest-ServersTestFqdnHostnames-795084039-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 578.427859] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-1431f013-cf4f-4b3f-a0f8-ce39b5d567d2 tempest-ServersTestFqdnHostnames-795084039 tempest-ServersTestFqdnHostnames-795084039-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 578.482544] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-1431f013-cf4f-4b3f-a0f8-ce39b5d567d2 tempest-ServersTestFqdnHostnames-795084039 tempest-ServersTestFqdnHostnames-795084039-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 578.482953] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-1431f013-cf4f-4b3f-a0f8-ce39b5d567d2 tempest-ServersTestFqdnHostnames-795084039 tempest-ServersTestFqdnHostnames-795084039-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 578.482953] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-1431f013-cf4f-4b3f-a0f8-ce39b5d567d2 tempest-ServersTestFqdnHostnames-795084039 tempest-ServersTestFqdnHostnames-795084039-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 578.489655] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-1431f013-cf4f-4b3f-a0f8-ce39b5d567d2 tempest-ServersTestFqdnHostnames-795084039 tempest-ServersTestFqdnHostnames-795084039-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 578.489881] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-1431f013-cf4f-4b3f-a0f8-ce39b5d567d2 tempest-ServersTestFqdnHostnames-795084039 tempest-ServersTestFqdnHostnames-795084039-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 578.490086] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-1431f013-cf4f-4b3f-a0f8-ce39b5d567d2 tempest-ServersTestFqdnHostnames-795084039 tempest-ServersTestFqdnHostnames-795084039-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 578.492367] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-1431f013-cf4f-4b3f-a0f8-ce39b5d567d2 tempest-ServersTestFqdnHostnames-795084039 tempest-ServersTestFqdnHostnames-795084039-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 578.492718] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-1431f013-cf4f-4b3f-a0f8-ce39b5d567d2 tempest-ServersTestFqdnHostnames-795084039 tempest-ServersTestFqdnHostnames-795084039-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 578.493397] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-1431f013-cf4f-4b3f-a0f8-ce39b5d567d2 tempest-ServersTestFqdnHostnames-795084039 tempest-ServersTestFqdnHostnames-795084039-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=6,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='0',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='4',num_task_spawning='6',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:03:03Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 578.493397] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-1431f013-cf4f-4b3f-a0f8-ce39b5d567d2 tempest-ServersTestFqdnHostnames-795084039 tempest-ServersTestFqdnHostnames-795084039-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 578.493594] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-1431f013-cf4f-4b3f-a0f8-ce39b5d567d2 tempest-ServersTestFqdnHostnames-795084039 tempest-ServersTestFqdnHostnames-795084039-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 578.493676] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-1431f013-cf4f-4b3f-a0f8-ce39b5d567d2 tempest-ServersTestFqdnHostnames-795084039 tempest-ServersTestFqdnHostnames-795084039-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 578.493850] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-1431f013-cf4f-4b3f-a0f8-ce39b5d567d2 tempest-ServersTestFqdnHostnames-795084039 tempest-ServersTestFqdnHostnames-795084039-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 578.494127] nova-scheduler[51959]: DEBUG nova.filters [None req-1431f013-cf4f-4b3f-a0f8-ce39b5d567d2 tempest-ServersTestFqdnHostnames-795084039 tempest-ServersTestFqdnHostnames-795084039-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 578.494345] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-1431f013-cf4f-4b3f-a0f8-ce39b5d567d2 tempest-ServersTestFqdnHostnames-795084039 tempest-ServersTestFqdnHostnames-795084039-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 104.356583 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 578.494509] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-1431f013-cf4f-4b3f-a0f8-ce39b5d567d2 tempest-ServersTestFqdnHostnames-795084039 tempest-ServersTestFqdnHostnames-795084039-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 578.494668] nova-scheduler[51959]: INFO nova.filters [None req-1431f013-cf4f-4b3f-a0f8-ce39b5d567d2 tempest-ServersTestFqdnHostnames-795084039 tempest-ServersTestFqdnHostnames-795084039-project-member] Filter ComputeFilter returned 0 hosts [ 578.494821] nova-scheduler[51959]: DEBUG nova.filters [None req-1431f013-cf4f-4b3f-a0f8-ce39b5d567d2 tempest-ServersTestFqdnHostnames-795084039 tempest-ServersTestFqdnHostnames-795084039-project-member] Filtering removed all hosts for the request with instance ID '9c8a34dd-510f-45c6-b748-f441f21e0b70'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 578.494965] nova-scheduler[51959]: INFO nova.filters [None req-1431f013-cf4f-4b3f-a0f8-ce39b5d567d2 tempest-ServersTestFqdnHostnames-795084039 tempest-ServersTestFqdnHostnames-795084039-project-member] Filtering removed all hosts for the request with instance ID '9c8a34dd-510f-45c6-b748-f441f21e0b70'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 578.495133] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-1431f013-cf4f-4b3f-a0f8-ce39b5d567d2 tempest-ServersTestFqdnHostnames-795084039 tempest-ServersTestFqdnHostnames-795084039-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 578.495287] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-1431f013-cf4f-4b3f-a0f8-ce39b5d567d2 tempest-ServersTestFqdnHostnames-795084039 tempest-ServersTestFqdnHostnames-795084039-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 581.701775] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-fada62a4-d4b4-48ab-98a9-12a4b2741cb3 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Starting to schedule for instances: ['0637688f-a7a4-4df1-a56b-553812f5b449'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 581.702062] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-fada62a4-d4b4-48ab-98a9-12a4b2741cb3 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 581.702107] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-fada62a4-d4b4-48ab-98a9-12a4b2741cb3 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 581.702574] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-fada62a4-d4b4-48ab-98a9-12a4b2741cb3 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 581.702574] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-fada62a4-d4b4-48ab-98a9-12a4b2741cb3 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 581.703864] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-fada62a4-d4b4-48ab-98a9-12a4b2741cb3 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 581.746155] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-fada62a4-d4b4-48ab-98a9-12a4b2741cb3 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 581.746733] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-fada62a4-d4b4-48ab-98a9-12a4b2741cb3 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 581.747062] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-fada62a4-d4b4-48ab-98a9-12a4b2741cb3 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 581.753881] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-fada62a4-d4b4-48ab-98a9-12a4b2741cb3 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 581.754109] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-fada62a4-d4b4-48ab-98a9-12a4b2741cb3 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 581.754288] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-fada62a4-d4b4-48ab-98a9-12a4b2741cb3 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 581.756665] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-fada62a4-d4b4-48ab-98a9-12a4b2741cb3 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 581.756864] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-fada62a4-d4b4-48ab-98a9-12a4b2741cb3 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 581.757242] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-fada62a4-d4b4-48ab-98a9-12a4b2741cb3 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=6,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='0',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='4',num_task_spawning='6',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:03:03Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 581.757673] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-fada62a4-d4b4-48ab-98a9-12a4b2741cb3 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 581.757758] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-fada62a4-d4b4-48ab-98a9-12a4b2741cb3 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 581.757989] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-fada62a4-d4b4-48ab-98a9-12a4b2741cb3 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 581.758100] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-fada62a4-d4b4-48ab-98a9-12a4b2741cb3 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 581.758278] nova-scheduler[51961]: DEBUG nova.filters [None req-fada62a4-d4b4-48ab-98a9-12a4b2741cb3 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 581.758492] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-fada62a4-d4b4-48ab-98a9-12a4b2741cb3 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 107.62073 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 581.758989] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-fada62a4-d4b4-48ab-98a9-12a4b2741cb3 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 581.758989] nova-scheduler[51961]: INFO nova.filters [None req-fada62a4-d4b4-48ab-98a9-12a4b2741cb3 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filter ComputeFilter returned 0 hosts [ 581.758989] nova-scheduler[51961]: DEBUG nova.filters [None req-fada62a4-d4b4-48ab-98a9-12a4b2741cb3 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filtering removed all hosts for the request with instance ID '0637688f-a7a4-4df1-a56b-553812f5b449'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 581.759842] nova-scheduler[51961]: INFO nova.filters [None req-fada62a4-d4b4-48ab-98a9-12a4b2741cb3 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filtering removed all hosts for the request with instance ID '0637688f-a7a4-4df1-a56b-553812f5b449'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 581.759842] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-fada62a4-d4b4-48ab-98a9-12a4b2741cb3 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 581.759842] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-fada62a4-d4b4-48ab-98a9-12a4b2741cb3 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 582.957871] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-93e55be2-2d6c-4ca6-8114-91c144aeb644 tempest-ImagesOneServerTestJSON-427840070 tempest-ImagesOneServerTestJSON-427840070-project-member] Starting to schedule for instances: ['bbd77202-5206-425a-96f7-e69110c2d58c'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 582.958740] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-93e55be2-2d6c-4ca6-8114-91c144aeb644 tempest-ImagesOneServerTestJSON-427840070 tempest-ImagesOneServerTestJSON-427840070-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 582.959291] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-93e55be2-2d6c-4ca6-8114-91c144aeb644 tempest-ImagesOneServerTestJSON-427840070 tempest-ImagesOneServerTestJSON-427840070-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 582.959687] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-93e55be2-2d6c-4ca6-8114-91c144aeb644 tempest-ImagesOneServerTestJSON-427840070 tempest-ImagesOneServerTestJSON-427840070-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 582.959824] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-93e55be2-2d6c-4ca6-8114-91c144aeb644 tempest-ImagesOneServerTestJSON-427840070 tempest-ImagesOneServerTestJSON-427840070-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 582.960201] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-93e55be2-2d6c-4ca6-8114-91c144aeb644 tempest-ImagesOneServerTestJSON-427840070 tempest-ImagesOneServerTestJSON-427840070-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 583.022561] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-93e55be2-2d6c-4ca6-8114-91c144aeb644 tempest-ImagesOneServerTestJSON-427840070 tempest-ImagesOneServerTestJSON-427840070-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 583.022561] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-93e55be2-2d6c-4ca6-8114-91c144aeb644 tempest-ImagesOneServerTestJSON-427840070 tempest-ImagesOneServerTestJSON-427840070-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 583.022561] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-93e55be2-2d6c-4ca6-8114-91c144aeb644 tempest-ImagesOneServerTestJSON-427840070 tempest-ImagesOneServerTestJSON-427840070-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 583.028557] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-93e55be2-2d6c-4ca6-8114-91c144aeb644 tempest-ImagesOneServerTestJSON-427840070 tempest-ImagesOneServerTestJSON-427840070-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 583.028938] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-93e55be2-2d6c-4ca6-8114-91c144aeb644 tempest-ImagesOneServerTestJSON-427840070 tempest-ImagesOneServerTestJSON-427840070-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 583.029256] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-93e55be2-2d6c-4ca6-8114-91c144aeb644 tempest-ImagesOneServerTestJSON-427840070 tempest-ImagesOneServerTestJSON-427840070-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 583.032751] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-93e55be2-2d6c-4ca6-8114-91c144aeb644 tempest-ImagesOneServerTestJSON-427840070 tempest-ImagesOneServerTestJSON-427840070-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 583.034332] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-93e55be2-2d6c-4ca6-8114-91c144aeb644 tempest-ImagesOneServerTestJSON-427840070 tempest-ImagesOneServerTestJSON-427840070-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.002s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 583.034724] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-93e55be2-2d6c-4ca6-8114-91c144aeb644 tempest-ImagesOneServerTestJSON-427840070 tempest-ImagesOneServerTestJSON-427840070-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=6,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='0',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='4',num_task_spawning='6',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:03:03Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 583.035026] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-93e55be2-2d6c-4ca6-8114-91c144aeb644 tempest-ImagesOneServerTestJSON-427840070 tempest-ImagesOneServerTestJSON-427840070-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 583.035199] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-93e55be2-2d6c-4ca6-8114-91c144aeb644 tempest-ImagesOneServerTestJSON-427840070 tempest-ImagesOneServerTestJSON-427840070-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 583.035360] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-93e55be2-2d6c-4ca6-8114-91c144aeb644 tempest-ImagesOneServerTestJSON-427840070 tempest-ImagesOneServerTestJSON-427840070-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 583.035528] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-93e55be2-2d6c-4ca6-8114-91c144aeb644 tempest-ImagesOneServerTestJSON-427840070 tempest-ImagesOneServerTestJSON-427840070-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 583.035783] nova-scheduler[51959]: DEBUG nova.filters [None req-93e55be2-2d6c-4ca6-8114-91c144aeb644 tempest-ImagesOneServerTestJSON-427840070 tempest-ImagesOneServerTestJSON-427840070-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 583.035996] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-93e55be2-2d6c-4ca6-8114-91c144aeb644 tempest-ImagesOneServerTestJSON-427840070 tempest-ImagesOneServerTestJSON-427840070-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 108.89824 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 583.036164] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-93e55be2-2d6c-4ca6-8114-91c144aeb644 tempest-ImagesOneServerTestJSON-427840070 tempest-ImagesOneServerTestJSON-427840070-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 583.036333] nova-scheduler[51959]: INFO nova.filters [None req-93e55be2-2d6c-4ca6-8114-91c144aeb644 tempest-ImagesOneServerTestJSON-427840070 tempest-ImagesOneServerTestJSON-427840070-project-member] Filter ComputeFilter returned 0 hosts [ 583.036483] nova-scheduler[51959]: DEBUG nova.filters [None req-93e55be2-2d6c-4ca6-8114-91c144aeb644 tempest-ImagesOneServerTestJSON-427840070 tempest-ImagesOneServerTestJSON-427840070-project-member] Filtering removed all hosts for the request with instance ID 'bbd77202-5206-425a-96f7-e69110c2d58c'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 583.036623] nova-scheduler[51959]: INFO nova.filters [None req-93e55be2-2d6c-4ca6-8114-91c144aeb644 tempest-ImagesOneServerTestJSON-427840070 tempest-ImagesOneServerTestJSON-427840070-project-member] Filtering removed all hosts for the request with instance ID 'bbd77202-5206-425a-96f7-e69110c2d58c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 583.036786] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-93e55be2-2d6c-4ca6-8114-91c144aeb644 tempest-ImagesOneServerTestJSON-427840070 tempest-ImagesOneServerTestJSON-427840070-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 583.036912] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-93e55be2-2d6c-4ca6-8114-91c144aeb644 tempest-ImagesOneServerTestJSON-427840070 tempest-ImagesOneServerTestJSON-427840070-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 585.571813] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-dbe3949e-10de-4472-b703-178e536cd114 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 585.572083] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-dbe3949e-10de-4472-b703-178e536cd114 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 585.572427] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-dbe3949e-10de-4472-b703-178e536cd114 None None] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 585.572626] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-dbe3949e-10de-4472-b703-178e536cd114 None None] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 585.572857] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-dbe3949e-10de-4472-b703-178e536cd114 None None] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 585.573825] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-dbe3949e-10de-4472-b703-178e536cd114 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 585.574096] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-dbe3949e-10de-4472-b703-178e536cd114 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 585.574428] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-dbe3949e-10de-4472-b703-178e536cd114 None None] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 585.574615] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-dbe3949e-10de-4472-b703-178e536cd114 None None] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 585.574786] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-dbe3949e-10de-4472-b703-178e536cd114 None None] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 585.579588] nova-scheduler[51961]: INFO nova.scheduler.host_manager [None req-dbe3949e-10de-4472-b703-178e536cd114 None None] Received a sync request from an unknown host 'cpu-1'. Re-created its InstanceList. [ 585.579588] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-dbe3949e-10de-4472-b703-178e536cd114 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.005s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 585.581456] nova-scheduler[51959]: INFO nova.scheduler.host_manager [None req-dbe3949e-10de-4472-b703-178e536cd114 None None] Received a sync request from an unknown host 'cpu-1'. Re-created its InstanceList. [ 585.581819] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-dbe3949e-10de-4472-b703-178e536cd114 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.010s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 585.695017] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-02cfa338-ab06-4340-a422-ace14c369657 tempest-ServerActionsTestJSON-1901113518 tempest-ServerActionsTestJSON-1901113518-project-member] Starting to schedule for instances: ['f43715a1-50ec-448a-9a6d-4fda11ee2099'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 585.695017] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-02cfa338-ab06-4340-a422-ace14c369657 tempest-ServerActionsTestJSON-1901113518 tempest-ServerActionsTestJSON-1901113518-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 585.695017] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-02cfa338-ab06-4340-a422-ace14c369657 tempest-ServerActionsTestJSON-1901113518 tempest-ServerActionsTestJSON-1901113518-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 585.695198] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-02cfa338-ab06-4340-a422-ace14c369657 tempest-ServerActionsTestJSON-1901113518 tempest-ServerActionsTestJSON-1901113518-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 585.695366] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-02cfa338-ab06-4340-a422-ace14c369657 tempest-ServerActionsTestJSON-1901113518 tempest-ServerActionsTestJSON-1901113518-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 585.695571] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-02cfa338-ab06-4340-a422-ace14c369657 tempest-ServerActionsTestJSON-1901113518 tempest-ServerActionsTestJSON-1901113518-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 585.738182] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-02cfa338-ab06-4340-a422-ace14c369657 tempest-ServerActionsTestJSON-1901113518 tempest-ServerActionsTestJSON-1901113518-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 585.738426] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-02cfa338-ab06-4340-a422-ace14c369657 tempest-ServerActionsTestJSON-1901113518 tempest-ServerActionsTestJSON-1901113518-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 585.738604] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-02cfa338-ab06-4340-a422-ace14c369657 tempest-ServerActionsTestJSON-1901113518 tempest-ServerActionsTestJSON-1901113518-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 585.745889] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-02cfa338-ab06-4340-a422-ace14c369657 tempest-ServerActionsTestJSON-1901113518 tempest-ServerActionsTestJSON-1901113518-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 585.746515] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-02cfa338-ab06-4340-a422-ace14c369657 tempest-ServerActionsTestJSON-1901113518 tempest-ServerActionsTestJSON-1901113518-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 585.746741] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-02cfa338-ab06-4340-a422-ace14c369657 tempest-ServerActionsTestJSON-1901113518 tempest-ServerActionsTestJSON-1901113518-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 585.749044] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-02cfa338-ab06-4340-a422-ace14c369657 tempest-ServerActionsTestJSON-1901113518 tempest-ServerActionsTestJSON-1901113518-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 585.749269] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-02cfa338-ab06-4340-a422-ace14c369657 tempest-ServerActionsTestJSON-1901113518 tempest-ServerActionsTestJSON-1901113518-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 585.749692] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-02cfa338-ab06-4340-a422-ace14c369657 tempest-ServerActionsTestJSON-1901113518 tempest-ServerActionsTestJSON-1901113518-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=6,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_da83cfec83084d7bbcc161d5d7b287c4='0',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='4',num_task_spawning='6',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:03:03Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 585.749995] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-02cfa338-ab06-4340-a422-ace14c369657 tempest-ServerActionsTestJSON-1901113518 tempest-ServerActionsTestJSON-1901113518-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 585.750192] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-02cfa338-ab06-4340-a422-ace14c369657 tempest-ServerActionsTestJSON-1901113518 tempest-ServerActionsTestJSON-1901113518-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 585.750363] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-02cfa338-ab06-4340-a422-ace14c369657 tempest-ServerActionsTestJSON-1901113518 tempest-ServerActionsTestJSON-1901113518-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 585.750539] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-02cfa338-ab06-4340-a422-ace14c369657 tempest-ServerActionsTestJSON-1901113518 tempest-ServerActionsTestJSON-1901113518-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 585.750794] nova-scheduler[51961]: DEBUG nova.filters [None req-02cfa338-ab06-4340-a422-ace14c369657 tempest-ServerActionsTestJSON-1901113518 tempest-ServerActionsTestJSON-1901113518-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 585.750999] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-02cfa338-ab06-4340-a422-ace14c369657 tempest-ServerActionsTestJSON-1901113518 tempest-ServerActionsTestJSON-1901113518-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 111.613243 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 585.751202] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-02cfa338-ab06-4340-a422-ace14c369657 tempest-ServerActionsTestJSON-1901113518 tempest-ServerActionsTestJSON-1901113518-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 585.751329] nova-scheduler[51961]: INFO nova.filters [None req-02cfa338-ab06-4340-a422-ace14c369657 tempest-ServerActionsTestJSON-1901113518 tempest-ServerActionsTestJSON-1901113518-project-member] Filter ComputeFilter returned 0 hosts [ 585.751511] nova-scheduler[51961]: DEBUG nova.filters [None req-02cfa338-ab06-4340-a422-ace14c369657 tempest-ServerActionsTestJSON-1901113518 tempest-ServerActionsTestJSON-1901113518-project-member] Filtering removed all hosts for the request with instance ID 'f43715a1-50ec-448a-9a6d-4fda11ee2099'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 585.751692] nova-scheduler[51961]: INFO nova.filters [None req-02cfa338-ab06-4340-a422-ace14c369657 tempest-ServerActionsTestJSON-1901113518 tempest-ServerActionsTestJSON-1901113518-project-member] Filtering removed all hosts for the request with instance ID 'f43715a1-50ec-448a-9a6d-4fda11ee2099'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 585.751803] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-02cfa338-ab06-4340-a422-ace14c369657 tempest-ServerActionsTestJSON-1901113518 tempest-ServerActionsTestJSON-1901113518-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 585.751966] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-02cfa338-ab06-4340-a422-ace14c369657 tempest-ServerActionsTestJSON-1901113518 tempest-ServerActionsTestJSON-1901113518-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 586.562256] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-6b913048-ad61-47b9-95e2-ea3f66a9cc7e tempest-ServerActionsV293TestJSON-1631288998 tempest-ServerActionsV293TestJSON-1631288998-project-member] Starting to schedule for instances: ['38148aac-e7ce-467a-8d41-8493049511a4'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 586.562256] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-6b913048-ad61-47b9-95e2-ea3f66a9cc7e tempest-ServerActionsV293TestJSON-1631288998 tempest-ServerActionsV293TestJSON-1631288998-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 586.562256] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-6b913048-ad61-47b9-95e2-ea3f66a9cc7e tempest-ServerActionsV293TestJSON-1631288998 tempest-ServerActionsV293TestJSON-1631288998-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 586.562256] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-6b913048-ad61-47b9-95e2-ea3f66a9cc7e tempest-ServerActionsV293TestJSON-1631288998 tempest-ServerActionsV293TestJSON-1631288998-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 586.562256] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-6b913048-ad61-47b9-95e2-ea3f66a9cc7e tempest-ServerActionsV293TestJSON-1631288998 tempest-ServerActionsV293TestJSON-1631288998-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 586.562572] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-6b913048-ad61-47b9-95e2-ea3f66a9cc7e tempest-ServerActionsV293TestJSON-1631288998 tempest-ServerActionsV293TestJSON-1631288998-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 586.611150] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-6b913048-ad61-47b9-95e2-ea3f66a9cc7e tempest-ServerActionsV293TestJSON-1631288998 tempest-ServerActionsV293TestJSON-1631288998-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 586.611150] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-6b913048-ad61-47b9-95e2-ea3f66a9cc7e tempest-ServerActionsV293TestJSON-1631288998 tempest-ServerActionsV293TestJSON-1631288998-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 586.611150] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-6b913048-ad61-47b9-95e2-ea3f66a9cc7e tempest-ServerActionsV293TestJSON-1631288998 tempest-ServerActionsV293TestJSON-1631288998-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 586.616325] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-6b913048-ad61-47b9-95e2-ea3f66a9cc7e tempest-ServerActionsV293TestJSON-1631288998 tempest-ServerActionsV293TestJSON-1631288998-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 586.616630] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-6b913048-ad61-47b9-95e2-ea3f66a9cc7e tempest-ServerActionsV293TestJSON-1631288998 tempest-ServerActionsV293TestJSON-1631288998-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 586.616725] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-6b913048-ad61-47b9-95e2-ea3f66a9cc7e tempest-ServerActionsV293TestJSON-1631288998 tempest-ServerActionsV293TestJSON-1631288998-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 586.620035] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-6b913048-ad61-47b9-95e2-ea3f66a9cc7e tempest-ServerActionsV293TestJSON-1631288998 tempest-ServerActionsV293TestJSON-1631288998-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 586.620035] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-6b913048-ad61-47b9-95e2-ea3f66a9cc7e tempest-ServerActionsV293TestJSON-1631288998 tempest-ServerActionsV293TestJSON-1631288998-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 586.620035] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-6b913048-ad61-47b9-95e2-ea3f66a9cc7e tempest-ServerActionsV293TestJSON-1631288998 tempest-ServerActionsV293TestJSON-1631288998-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:03:16Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 586.620373] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-6b913048-ad61-47b9-95e2-ea3f66a9cc7e tempest-ServerActionsV293TestJSON-1631288998 tempest-ServerActionsV293TestJSON-1631288998-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 586.620544] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-6b913048-ad61-47b9-95e2-ea3f66a9cc7e tempest-ServerActionsV293TestJSON-1631288998 tempest-ServerActionsV293TestJSON-1631288998-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 586.620721] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-6b913048-ad61-47b9-95e2-ea3f66a9cc7e tempest-ServerActionsV293TestJSON-1631288998 tempest-ServerActionsV293TestJSON-1631288998-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 586.620884] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-6b913048-ad61-47b9-95e2-ea3f66a9cc7e tempest-ServerActionsV293TestJSON-1631288998 tempest-ServerActionsV293TestJSON-1631288998-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 586.621138] nova-scheduler[51959]: DEBUG nova.filters [None req-6b913048-ad61-47b9-95e2-ea3f66a9cc7e tempest-ServerActionsV293TestJSON-1631288998 tempest-ServerActionsV293TestJSON-1631288998-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 586.621358] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-6b913048-ad61-47b9-95e2-ea3f66a9cc7e tempest-ServerActionsV293TestJSON-1631288998 tempest-ServerActionsV293TestJSON-1631288998-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 112.483594 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 586.621556] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-6b913048-ad61-47b9-95e2-ea3f66a9cc7e tempest-ServerActionsV293TestJSON-1631288998 tempest-ServerActionsV293TestJSON-1631288998-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 586.621728] nova-scheduler[51959]: INFO nova.filters [None req-6b913048-ad61-47b9-95e2-ea3f66a9cc7e tempest-ServerActionsV293TestJSON-1631288998 tempest-ServerActionsV293TestJSON-1631288998-project-member] Filter ComputeFilter returned 0 hosts [ 586.621914] nova-scheduler[51959]: DEBUG nova.filters [None req-6b913048-ad61-47b9-95e2-ea3f66a9cc7e tempest-ServerActionsV293TestJSON-1631288998 tempest-ServerActionsV293TestJSON-1631288998-project-member] Filtering removed all hosts for the request with instance ID '38148aac-e7ce-467a-8d41-8493049511a4'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 586.622060] nova-scheduler[51959]: INFO nova.filters [None req-6b913048-ad61-47b9-95e2-ea3f66a9cc7e tempest-ServerActionsV293TestJSON-1631288998 tempest-ServerActionsV293TestJSON-1631288998-project-member] Filtering removed all hosts for the request with instance ID '38148aac-e7ce-467a-8d41-8493049511a4'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 586.622210] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-6b913048-ad61-47b9-95e2-ea3f66a9cc7e tempest-ServerActionsV293TestJSON-1631288998 tempest-ServerActionsV293TestJSON-1631288998-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 586.622354] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-6b913048-ad61-47b9-95e2-ea3f66a9cc7e tempest-ServerActionsV293TestJSON-1631288998 tempest-ServerActionsV293TestJSON-1631288998-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 590.626943] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-8608cac2-38ae-4f23-a50f-57b3a435aa63 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Starting to schedule for instances: ['b0ba526b-7004-45cd-877c-d21d4e88b703'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 590.627205] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-8608cac2-38ae-4f23-a50f-57b3a435aa63 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 590.628102] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-8608cac2-38ae-4f23-a50f-57b3a435aa63 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 590.628102] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-8608cac2-38ae-4f23-a50f-57b3a435aa63 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 590.628102] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-8608cac2-38ae-4f23-a50f-57b3a435aa63 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 590.628102] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-8608cac2-38ae-4f23-a50f-57b3a435aa63 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 590.682472] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-8608cac2-38ae-4f23-a50f-57b3a435aa63 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 590.682641] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-8608cac2-38ae-4f23-a50f-57b3a435aa63 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 590.682910] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-8608cac2-38ae-4f23-a50f-57b3a435aa63 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 590.691846] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-8608cac2-38ae-4f23-a50f-57b3a435aa63 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 590.691846] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-8608cac2-38ae-4f23-a50f-57b3a435aa63 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 590.691846] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-8608cac2-38ae-4f23-a50f-57b3a435aa63 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 590.694487] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-8608cac2-38ae-4f23-a50f-57b3a435aa63 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 590.695879] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-8608cac2-38ae-4f23-a50f-57b3a435aa63 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 590.695879] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-8608cac2-38ae-4f23-a50f-57b3a435aa63 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:03:16Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 590.695879] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-8608cac2-38ae-4f23-a50f-57b3a435aa63 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 590.695879] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-8608cac2-38ae-4f23-a50f-57b3a435aa63 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 590.695879] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-8608cac2-38ae-4f23-a50f-57b3a435aa63 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 590.695879] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-8608cac2-38ae-4f23-a50f-57b3a435aa63 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 590.696268] nova-scheduler[51961]: DEBUG nova.filters [None req-8608cac2-38ae-4f23-a50f-57b3a435aa63 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 590.696361] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-8608cac2-38ae-4f23-a50f-57b3a435aa63 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 116.558591 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 590.696511] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-8608cac2-38ae-4f23-a50f-57b3a435aa63 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 590.696672] nova-scheduler[51961]: INFO nova.filters [None req-8608cac2-38ae-4f23-a50f-57b3a435aa63 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filter ComputeFilter returned 0 hosts [ 590.696823] nova-scheduler[51961]: DEBUG nova.filters [None req-8608cac2-38ae-4f23-a50f-57b3a435aa63 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filtering removed all hosts for the request with instance ID 'b0ba526b-7004-45cd-877c-d21d4e88b703'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 590.696965] nova-scheduler[51961]: INFO nova.filters [None req-8608cac2-38ae-4f23-a50f-57b3a435aa63 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filtering removed all hosts for the request with instance ID 'b0ba526b-7004-45cd-877c-d21d4e88b703'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 590.697742] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-8608cac2-38ae-4f23-a50f-57b3a435aa63 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 590.697742] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-8608cac2-38ae-4f23-a50f-57b3a435aa63 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 591.582030] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-53fd4e0c-6aba-438c-8326-d4c1be61ed35 tempest-ServerShowV254Test-666283222 tempest-ServerShowV254Test-666283222-project-member] Starting to schedule for instances: ['4f739535-273b-4806-897e-ddbf12138e6a'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 591.582030] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-53fd4e0c-6aba-438c-8326-d4c1be61ed35 tempest-ServerShowV254Test-666283222 tempest-ServerShowV254Test-666283222-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 591.582030] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-53fd4e0c-6aba-438c-8326-d4c1be61ed35 tempest-ServerShowV254Test-666283222 tempest-ServerShowV254Test-666283222-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 591.582030] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-53fd4e0c-6aba-438c-8326-d4c1be61ed35 tempest-ServerShowV254Test-666283222 tempest-ServerShowV254Test-666283222-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 591.582030] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-53fd4e0c-6aba-438c-8326-d4c1be61ed35 tempest-ServerShowV254Test-666283222 tempest-ServerShowV254Test-666283222-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 591.582030] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-53fd4e0c-6aba-438c-8326-d4c1be61ed35 tempest-ServerShowV254Test-666283222 tempest-ServerShowV254Test-666283222-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 591.633253] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-53fd4e0c-6aba-438c-8326-d4c1be61ed35 tempest-ServerShowV254Test-666283222 tempest-ServerShowV254Test-666283222-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 591.633481] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-53fd4e0c-6aba-438c-8326-d4c1be61ed35 tempest-ServerShowV254Test-666283222 tempest-ServerShowV254Test-666283222-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 591.633653] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-53fd4e0c-6aba-438c-8326-d4c1be61ed35 tempest-ServerShowV254Test-666283222 tempest-ServerShowV254Test-666283222-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 591.646438] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-53fd4e0c-6aba-438c-8326-d4c1be61ed35 tempest-ServerShowV254Test-666283222 tempest-ServerShowV254Test-666283222-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 591.646658] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-53fd4e0c-6aba-438c-8326-d4c1be61ed35 tempest-ServerShowV254Test-666283222 tempest-ServerShowV254Test-666283222-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 591.646826] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-53fd4e0c-6aba-438c-8326-d4c1be61ed35 tempest-ServerShowV254Test-666283222 tempest-ServerShowV254Test-666283222-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 591.650147] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-53fd4e0c-6aba-438c-8326-d4c1be61ed35 tempest-ServerShowV254Test-666283222 tempest-ServerShowV254Test-666283222-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 591.650642] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-53fd4e0c-6aba-438c-8326-d4c1be61ed35 tempest-ServerShowV254Test-666283222 tempest-ServerShowV254Test-666283222-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 591.650774] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-53fd4e0c-6aba-438c-8326-d4c1be61ed35 tempest-ServerShowV254Test-666283222 tempest-ServerShowV254Test-666283222-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:03:16Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 591.651072] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-53fd4e0c-6aba-438c-8326-d4c1be61ed35 tempest-ServerShowV254Test-666283222 tempest-ServerShowV254Test-666283222-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 591.651560] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-53fd4e0c-6aba-438c-8326-d4c1be61ed35 tempest-ServerShowV254Test-666283222 tempest-ServerShowV254Test-666283222-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 591.651754] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-53fd4e0c-6aba-438c-8326-d4c1be61ed35 tempest-ServerShowV254Test-666283222 tempest-ServerShowV254Test-666283222-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 591.652189] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-53fd4e0c-6aba-438c-8326-d4c1be61ed35 tempest-ServerShowV254Test-666283222 tempest-ServerShowV254Test-666283222-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 591.652189] nova-scheduler[51959]: DEBUG nova.filters [None req-53fd4e0c-6aba-438c-8326-d4c1be61ed35 tempest-ServerShowV254Test-666283222 tempest-ServerShowV254Test-666283222-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 591.652399] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-53fd4e0c-6aba-438c-8326-d4c1be61ed35 tempest-ServerShowV254Test-666283222 tempest-ServerShowV254Test-666283222-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 117.514646 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 591.652600] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-53fd4e0c-6aba-438c-8326-d4c1be61ed35 tempest-ServerShowV254Test-666283222 tempest-ServerShowV254Test-666283222-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 591.652775] nova-scheduler[51959]: INFO nova.filters [None req-53fd4e0c-6aba-438c-8326-d4c1be61ed35 tempest-ServerShowV254Test-666283222 tempest-ServerShowV254Test-666283222-project-member] Filter ComputeFilter returned 0 hosts [ 591.653023] nova-scheduler[51959]: DEBUG nova.filters [None req-53fd4e0c-6aba-438c-8326-d4c1be61ed35 tempest-ServerShowV254Test-666283222 tempest-ServerShowV254Test-666283222-project-member] Filtering removed all hosts for the request with instance ID '4f739535-273b-4806-897e-ddbf12138e6a'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 591.653176] nova-scheduler[51959]: INFO nova.filters [None req-53fd4e0c-6aba-438c-8326-d4c1be61ed35 tempest-ServerShowV254Test-666283222 tempest-ServerShowV254Test-666283222-project-member] Filtering removed all hosts for the request with instance ID '4f739535-273b-4806-897e-ddbf12138e6a'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 591.653325] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-53fd4e0c-6aba-438c-8326-d4c1be61ed35 tempest-ServerShowV254Test-666283222 tempest-ServerShowV254Test-666283222-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 591.653471] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-53fd4e0c-6aba-438c-8326-d4c1be61ed35 tempest-ServerShowV254Test-666283222 tempest-ServerShowV254Test-666283222-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 593.496170] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-96c2102f-84ea-490e-bb1a-dac1e6c16021 tempest-InstanceActionsV221TestJSON-1158573269 tempest-InstanceActionsV221TestJSON-1158573269-project-member] Starting to schedule for instances: ['b894028f-c5d3-4c54-9f32-004b6fd1d926'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 593.496689] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-96c2102f-84ea-490e-bb1a-dac1e6c16021 tempest-InstanceActionsV221TestJSON-1158573269 tempest-InstanceActionsV221TestJSON-1158573269-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 593.496689] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-96c2102f-84ea-490e-bb1a-dac1e6c16021 tempest-InstanceActionsV221TestJSON-1158573269 tempest-InstanceActionsV221TestJSON-1158573269-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 593.496861] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-96c2102f-84ea-490e-bb1a-dac1e6c16021 tempest-InstanceActionsV221TestJSON-1158573269 tempest-InstanceActionsV221TestJSON-1158573269-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 593.500633] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-96c2102f-84ea-490e-bb1a-dac1e6c16021 tempest-InstanceActionsV221TestJSON-1158573269 tempest-InstanceActionsV221TestJSON-1158573269-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 593.500633] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-96c2102f-84ea-490e-bb1a-dac1e6c16021 tempest-InstanceActionsV221TestJSON-1158573269 tempest-InstanceActionsV221TestJSON-1158573269-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 593.558691] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-96c2102f-84ea-490e-bb1a-dac1e6c16021 tempest-InstanceActionsV221TestJSON-1158573269 tempest-InstanceActionsV221TestJSON-1158573269-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 593.558937] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-96c2102f-84ea-490e-bb1a-dac1e6c16021 tempest-InstanceActionsV221TestJSON-1158573269 tempest-InstanceActionsV221TestJSON-1158573269-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 593.559351] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-96c2102f-84ea-490e-bb1a-dac1e6c16021 tempest-InstanceActionsV221TestJSON-1158573269 tempest-InstanceActionsV221TestJSON-1158573269-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 593.573702] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-96c2102f-84ea-490e-bb1a-dac1e6c16021 tempest-InstanceActionsV221TestJSON-1158573269 tempest-InstanceActionsV221TestJSON-1158573269-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 593.577174] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-96c2102f-84ea-490e-bb1a-dac1e6c16021 tempest-InstanceActionsV221TestJSON-1158573269 tempest-InstanceActionsV221TestJSON-1158573269-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 593.577455] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-96c2102f-84ea-490e-bb1a-dac1e6c16021 tempest-InstanceActionsV221TestJSON-1158573269 tempest-InstanceActionsV221TestJSON-1158573269-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 593.580240] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-96c2102f-84ea-490e-bb1a-dac1e6c16021 tempest-InstanceActionsV221TestJSON-1158573269 tempest-InstanceActionsV221TestJSON-1158573269-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 593.580312] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-96c2102f-84ea-490e-bb1a-dac1e6c16021 tempest-InstanceActionsV221TestJSON-1158573269 tempest-InstanceActionsV221TestJSON-1158573269-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 593.580705] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-96c2102f-84ea-490e-bb1a-dac1e6c16021 tempest-InstanceActionsV221TestJSON-1158573269 tempest-InstanceActionsV221TestJSON-1158573269-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:03:16Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 593.581104] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-96c2102f-84ea-490e-bb1a-dac1e6c16021 tempest-InstanceActionsV221TestJSON-1158573269 tempest-InstanceActionsV221TestJSON-1158573269-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 593.581676] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-96c2102f-84ea-490e-bb1a-dac1e6c16021 tempest-InstanceActionsV221TestJSON-1158573269 tempest-InstanceActionsV221TestJSON-1158573269-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 1, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 593.581676] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-96c2102f-84ea-490e-bb1a-dac1e6c16021 tempest-InstanceActionsV221TestJSON-1158573269 tempest-InstanceActionsV221TestJSON-1158573269-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 593.581676] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-96c2102f-84ea-490e-bb1a-dac1e6c16021 tempest-InstanceActionsV221TestJSON-1158573269 tempest-InstanceActionsV221TestJSON-1158573269-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 593.581914] nova-scheduler[51961]: DEBUG nova.filters [None req-96c2102f-84ea-490e-bb1a-dac1e6c16021 tempest-InstanceActionsV221TestJSON-1158573269 tempest-InstanceActionsV221TestJSON-1158573269-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 593.582031] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-96c2102f-84ea-490e-bb1a-dac1e6c16021 tempest-InstanceActionsV221TestJSON-1158573269 tempest-InstanceActionsV221TestJSON-1158573269-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:01:25. Elapsed time is 119.444263 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 593.582193] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-96c2102f-84ea-490e-bb1a-dac1e6c16021 tempest-InstanceActionsV221TestJSON-1158573269 tempest-InstanceActionsV221TestJSON-1158573269-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 593.582349] nova-scheduler[51961]: INFO nova.filters [None req-96c2102f-84ea-490e-bb1a-dac1e6c16021 tempest-InstanceActionsV221TestJSON-1158573269 tempest-InstanceActionsV221TestJSON-1158573269-project-member] Filter ComputeFilter returned 0 hosts [ 593.582498] nova-scheduler[51961]: DEBUG nova.filters [None req-96c2102f-84ea-490e-bb1a-dac1e6c16021 tempest-InstanceActionsV221TestJSON-1158573269 tempest-InstanceActionsV221TestJSON-1158573269-project-member] Filtering removed all hosts for the request with instance ID 'b894028f-c5d3-4c54-9f32-004b6fd1d926'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 593.582796] nova-scheduler[51961]: INFO nova.filters [None req-96c2102f-84ea-490e-bb1a-dac1e6c16021 tempest-InstanceActionsV221TestJSON-1158573269 tempest-InstanceActionsV221TestJSON-1158573269-project-member] Filtering removed all hosts for the request with instance ID 'b894028f-c5d3-4c54-9f32-004b6fd1d926'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 593.582796] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-96c2102f-84ea-490e-bb1a-dac1e6c16021 tempest-InstanceActionsV221TestJSON-1158573269 tempest-InstanceActionsV221TestJSON-1158573269-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 593.582927] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-96c2102f-84ea-490e-bb1a-dac1e6c16021 tempest-InstanceActionsV221TestJSON-1158573269 tempest-InstanceActionsV221TestJSON-1158573269-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 596.092097] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Starting to schedule for instances: ['6874067b-8e9b-4242-9a5f-6312f1484a00'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 596.092097] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 596.092097] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 596.092097] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 596.093464] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 596.093972] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 596.152169] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 596.152169] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 596.152169] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 596.162912] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 596.163594] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 596.163937] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 596.167775] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 596.167775] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 596.167775] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:03:16Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 596.167982] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 596.168250] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 596.168503] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 596.169545] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 596.169545] nova-scheduler[51959]: DEBUG nova.filters [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 596.169545] nova-scheduler[51959]: DEBUG nova.filters [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 596.169545] nova-scheduler[51959]: DEBUG nova.filters [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 596.170087] nova-scheduler[51959]: DEBUG nova.filters [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 596.170375] nova-scheduler[51959]: DEBUG nova.filters [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 596.170618] nova-scheduler[51959]: DEBUG nova.filters [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 596.170869] nova-scheduler[51959]: DEBUG nova.filters [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 596.171153] nova-scheduler[51959]: DEBUG nova.filters [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 596.171376] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 596.172523] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 596.172523] nova-scheduler[51959]: DEBUG nova.scheduler.utils [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Attempting to claim resources in the placement API for instance 6874067b-8e9b-4242-9a5f-6312f1484a00 {{(pid=51959) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 596.243381] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] [instance: 6874067b-8e9b-4242-9a5f-6312f1484a00] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51959) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 596.243381] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 596.243381] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 596.243381] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-7a57a820-6d71-4837-8066-3a74dbea2f2c tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 603.961650] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Starting to schedule for instances: ['f03f507b-364f-41b9-ad33-dcb56ab03317'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 603.961650] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 603.961650] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 603.961650] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 603.961650] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 603.961650] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 604.009750] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 604.010200] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 604.010200] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 604.018838] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 604.019094] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 604.019094] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 604.021707] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 604.021930] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 604.022337] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:03:16Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 604.022634] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 604.022831] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 604.023258] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 604.023448] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 604.023715] nova-scheduler[51961]: DEBUG nova.filters [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 604.023932] nova-scheduler[51961]: DEBUG nova.filters [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 604.024291] nova-scheduler[51961]: DEBUG nova.filters [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 604.024484] nova-scheduler[51961]: DEBUG nova.filters [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 604.024662] nova-scheduler[51961]: DEBUG nova.filters [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 604.024970] nova-scheduler[51961]: DEBUG nova.scheduler.filters.affinity_filter [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Group affinity: check if cpu-1 in [] {{(pid=51961) host_passes /opt/stack/nova/nova/scheduler/filters/affinity_filter.py:152}} [ 604.025164] nova-scheduler[51961]: DEBUG nova.filters [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 604.025352] nova-scheduler[51961]: DEBUG nova.filters [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 604.025523] nova-scheduler[51961]: DEBUG nova.filters [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 604.025686] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 604.025926] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 604.026146] nova-scheduler[51961]: DEBUG nova.scheduler.utils [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Attempting to claim resources in the placement API for instance f03f507b-364f-41b9-ad33-dcb56ab03317 {{(pid=51961) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 604.088847] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] [instance: f03f507b-364f-41b9-ad33-dcb56ab03317] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51961) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 604.090956] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 604.090956] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 604.090956] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0ff6ff40-b46c-46b7-900d-7f606e617772 tempest-ServerGroupTestJSON-1664601793 tempest-ServerGroupTestJSON-1664601793-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 605.407875] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Starting to schedule for instances: ['ea4a243b-481f-421d-ba29-c88c828f754e'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 605.408304] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 605.408543] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 605.408864] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 605.409735] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 605.409973] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 605.463415] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 605.464658] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 605.465484] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 605.468552] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Starting to schedule for instances: ['df997589-61b6-4f68-9169-e6f9bee650c7'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 605.468870] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 605.469048] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 605.469242] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 605.469447] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 605.469673] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 605.475770] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 605.479218] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 605.479428] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 605.482092] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 605.482472] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 605.483083] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:03:16Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 605.483429] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 605.483615] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 605.483782] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 605.483955] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 605.484233] nova-scheduler[51959]: DEBUG nova.filters [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 605.484446] nova-scheduler[51959]: DEBUG nova.filters [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 605.484636] nova-scheduler[51959]: DEBUG nova.filters [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 605.484843] nova-scheduler[51959]: DEBUG nova.filters [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 605.485021] nova-scheduler[51959]: DEBUG nova.filters [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 605.485194] nova-scheduler[51959]: DEBUG nova.filters [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 605.485372] nova-scheduler[51959]: DEBUG nova.filters [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 605.485529] nova-scheduler[51959]: DEBUG nova.filters [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 605.485687] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 605.485881] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 605.486072] nova-scheduler[51959]: DEBUG nova.scheduler.utils [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Attempting to claim resources in the placement API for instance ea4a243b-481f-421d-ba29-c88c828f754e {{(pid=51959) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 605.524484] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 605.524726] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 605.524906] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 605.531638] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 605.531876] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 605.532068] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 605.534535] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 605.535382] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 605.535858] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:03:16Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 605.536116] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 605.536300] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 605.536468] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 605.536744] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 605.536908] nova-scheduler[51961]: DEBUG nova.filters [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 605.537555] nova-scheduler[51961]: DEBUG nova.filters [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 605.537786] nova-scheduler[51961]: DEBUG nova.filters [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 605.538131] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] [instance: ea4a243b-481f-421d-ba29-c88c828f754e] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51959) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 605.538389] nova-scheduler[51961]: DEBUG nova.filters [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 605.538637] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 605.538800] nova-scheduler[51961]: DEBUG nova.filters [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 605.538946] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 605.539097] nova-scheduler[51961]: DEBUG nova.filters [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 605.539314] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-371dde63-be9b-4791-aed0-9952f41c246d tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 605.539458] nova-scheduler[51961]: DEBUG nova.filters [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 605.539680] nova-scheduler[51961]: DEBUG nova.filters [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 605.539854] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 605.540056] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 605.540253] nova-scheduler[51961]: DEBUG nova.scheduler.utils [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Attempting to claim resources in the placement API for instance df997589-61b6-4f68-9169-e6f9bee650c7 {{(pid=51961) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 605.607057] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] [instance: df997589-61b6-4f68-9169-e6f9bee650c7] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51961) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 605.607057] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 605.607057] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 605.607057] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-6e22221b-a0f2-4bed-96ff-40f7ade0c12d tempest-AttachInterfacesV270Test-209270185 tempest-AttachInterfacesV270Test-209270185-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 606.219721] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Starting to schedule for instances: ['b62dda0a-da1d-4109-a925-bb32d01da242'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 606.220977] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 606.221276] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 606.222397] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 606.222397] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 606.222397] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 606.275389] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 606.275623] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 606.275800] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 606.282751] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 606.283013] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 606.283195] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 606.288480] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 606.288689] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 606.289079] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:03:16Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 606.289398] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 606.289554] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 606.290143] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 606.290143] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 606.290143] nova-scheduler[51959]: DEBUG nova.filters [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 606.291043] nova-scheduler[51959]: DEBUG nova.filters [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 606.291043] nova-scheduler[51959]: DEBUG nova.filters [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 606.291043] nova-scheduler[51959]: DEBUG nova.filters [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 606.291043] nova-scheduler[51959]: DEBUG nova.filters [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 606.291043] nova-scheduler[51959]: DEBUG nova.filters [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 606.291246] nova-scheduler[51959]: DEBUG nova.filters [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 606.291461] nova-scheduler[51959]: DEBUG nova.filters [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 606.291540] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 606.291780] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 606.292253] nova-scheduler[51959]: DEBUG nova.scheduler.utils [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Attempting to claim resources in the placement API for instance b62dda0a-da1d-4109-a925-bb32d01da242 {{(pid=51959) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 606.379031] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] [instance: b62dda0a-da1d-4109-a925-bb32d01da242] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51959) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 606.379031] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 606.379031] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 606.379429] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-6f309cba-5afa-4dfc-86e4-f0361c865fd0 tempest-ImagesOneServerNegativeTestJSON-2067137125 tempest-ImagesOneServerNegativeTestJSON-2067137125-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 607.783444] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Starting to schedule for instances: ['6604de35-7683-4d5d-ac6f-13752ccb940c'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 607.783444] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 607.783444] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 607.783444] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 607.784456] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 607.784701] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 607.853751] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 607.854022] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 607.854235] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 607.862664] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 607.862908] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 607.863308] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 607.865637] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 607.865893] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 607.866447] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:03:16Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 607.866649] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 607.866755] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 607.866944] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 607.867100] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 607.867367] nova-scheduler[51961]: DEBUG nova.filters [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 607.867831] nova-scheduler[51961]: DEBUG nova.filters [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 607.868168] nova-scheduler[51961]: DEBUG nova.filters [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 607.868398] nova-scheduler[51961]: DEBUG nova.filters [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 607.868577] nova-scheduler[51961]: DEBUG nova.filters [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 607.868747] nova-scheduler[51961]: DEBUG nova.filters [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 607.868921] nova-scheduler[51961]: DEBUG nova.filters [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 607.869102] nova-scheduler[51961]: DEBUG nova.filters [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 607.869268] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 607.869441] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 607.869657] nova-scheduler[51961]: DEBUG nova.scheduler.utils [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Attempting to claim resources in the placement API for instance 6604de35-7683-4d5d-ac6f-13752ccb940c {{(pid=51961) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 607.956342] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] [instance: 6604de35-7683-4d5d-ac6f-13752ccb940c] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51961) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 607.956597] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 607.956647] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 607.956838] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-49a8e915-bce4-4384-b6b7-adba96e5e1e8 tempest-ServerActionsTestOtherA-1665339402 tempest-ServerActionsTestOtherA-1665339402-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 609.232214] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Starting to schedule for instances: ['189903f4-37c9-4331-bb23-245ed68ecaae'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 609.232214] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 609.232214] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 609.232214] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 609.233202] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 609.234181] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 609.294844] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 609.295087] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 609.295265] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 609.303665] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 609.303665] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 609.303665] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 609.306366] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 609.310675] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 609.310675] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:03:16Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 609.311028] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 609.311216] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 609.311384] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 609.311556] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.005s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 609.311914] nova-scheduler[51959]: DEBUG nova.filters [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 609.315027] nova-scheduler[51959]: DEBUG nova.filters [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 609.315027] nova-scheduler[51959]: DEBUG nova.filters [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 609.315027] nova-scheduler[51959]: DEBUG nova.filters [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 609.315027] nova-scheduler[51959]: DEBUG nova.filters [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 609.315027] nova-scheduler[51959]: DEBUG nova.filters [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 609.315027] nova-scheduler[51959]: DEBUG nova.filters [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 609.315027] nova-scheduler[51959]: DEBUG nova.filters [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 609.315027] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 609.315027] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 609.315027] nova-scheduler[51959]: DEBUG nova.scheduler.utils [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Attempting to claim resources in the placement API for instance 189903f4-37c9-4331-bb23-245ed68ecaae {{(pid=51959) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 609.388645] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] [instance: 189903f4-37c9-4331-bb23-245ed68ecaae] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51959) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 609.389824] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 609.389824] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 609.389824] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-5718d835-b6db-483d-96db-232287d8ec49 tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 610.013287] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Starting to schedule for instances: ['22aa54d4-80ec-4d56-9239-41810c469b9e'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 610.014080] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 610.014080] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 610.014080] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 610.014273] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 610.014436] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 610.024150] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Starting to schedule for instances: ['75cc0c18-27d3-4074-897b-08812a11829c'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 610.024601] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 610.024796] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 610.024862] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 610.025036] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 610.025199] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 610.079420] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 610.079728] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 610.079897] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 610.084187] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 610.084270] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 610.084441] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 610.088711] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 610.088711] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 610.088711] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 610.089792] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 610.090015] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 610.090536] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:03:16Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 610.090869] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 610.091061] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 610.091234] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 610.091423] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 610.091732] nova-scheduler[51961]: DEBUG nova.filters [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 610.092087] nova-scheduler[51961]: DEBUG nova.filters [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.092312] nova-scheduler[51961]: DEBUG nova.filters [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.092532] nova-scheduler[51961]: DEBUG nova.filters [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.093181] nova-scheduler[51961]: DEBUG nova.filters [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.093181] nova-scheduler[51961]: DEBUG nova.filters [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.093305] nova-scheduler[51961]: DEBUG nova.filters [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.093415] nova-scheduler[51961]: DEBUG nova.filters [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.093617] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 610.093781] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 610.093916] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 610.094089] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 610.094244] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 610.094391] nova-scheduler[51961]: DEBUG nova.scheduler.utils [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Attempting to claim resources in the placement API for instance 22aa54d4-80ec-4d56-9239-41810c469b9e {{(pid=51961) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 610.096859] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 610.097083] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 610.097786] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:03:16Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 610.097786] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 610.097924] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 610.098097] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 610.098270] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 610.098530] nova-scheduler[51959]: DEBUG nova.filters [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 610.098734] nova-scheduler[51959]: DEBUG nova.filters [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.098917] nova-scheduler[51959]: DEBUG nova.filters [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.099133] nova-scheduler[51959]: DEBUG nova.filters [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.102175] nova-scheduler[51959]: DEBUG nova.filters [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.102175] nova-scheduler[51959]: DEBUG nova.filters [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.102175] nova-scheduler[51959]: DEBUG nova.filters [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.102175] nova-scheduler[51959]: DEBUG nova.filters [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.102175] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 610.102175] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 610.102175] nova-scheduler[51959]: DEBUG nova.scheduler.utils [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Attempting to claim resources in the placement API for instance 75cc0c18-27d3-4074-897b-08812a11829c {{(pid=51959) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 610.176939] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] [instance: 75cc0c18-27d3-4074-897b-08812a11829c] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51959) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 610.177292] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 610.177511] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 610.177726] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-50852618-bfb2-45e1-9afb-62ea04595c1e tempest-ServersNegativeTestJSON-888982916 tempest-ServersNegativeTestJSON-888982916-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 610.202058] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] [instance: 22aa54d4-80ec-4d56-9239-41810c469b9e] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51961) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 610.202395] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 610.202613] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 610.202861] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-ada24a6c-d679-430b-9e9c-803e8277e103 tempest-ServerAddressesTestJSON-1259181591 tempest-ServerAddressesTestJSON-1259181591-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 610.545884] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Starting to schedule for instances: ['885fe65d-ee02-4ed7-8d59-109775086038'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 610.546226] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 610.546396] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 610.546584] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 610.546786] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 610.546987] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 610.591557] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 610.591870] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 610.592125] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 610.598590] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 610.598863] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 610.599163] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 610.601364] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 610.601574] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 610.601993] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:03:16Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 610.602302] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 610.602481] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 610.602645] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 610.602859] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 610.603177] nova-scheduler[51961]: DEBUG nova.filters [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 610.603398] nova-scheduler[51961]: DEBUG nova.filters [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.603588] nova-scheduler[51961]: DEBUG nova.filters [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.603792] nova-scheduler[51961]: DEBUG nova.filters [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.603971] nova-scheduler[51961]: DEBUG nova.filters [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.604156] nova-scheduler[51961]: DEBUG nova.filters [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.604330] nova-scheduler[51961]: DEBUG nova.filters [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.604497] nova-scheduler[51961]: DEBUG nova.filters [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.604730] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 610.604824] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 610.605015] nova-scheduler[51961]: DEBUG nova.scheduler.utils [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Attempting to claim resources in the placement API for instance 885fe65d-ee02-4ed7-8d59-109775086038 {{(pid=51961) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 610.655496] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] [instance: 885fe65d-ee02-4ed7-8d59-109775086038] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51961) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 610.655813] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 610.656039] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 610.656253] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0f1e22a8-9fae-4bca-95a7-848e187055da tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 611.719492] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Starting to schedule for instances: ['ec879414-4534-4d0e-a65e-65baff80b16e'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 611.719831] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 611.720013] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 611.720615] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 611.720860] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 611.721122] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 611.762863] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Starting to schedule for instances: ['cde76b14-ee01-44c8-8004-39cdf91e9889'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 611.763193] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 611.763364] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 611.763557] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 611.764100] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 611.764100] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 611.774684] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 611.774913] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 611.775095] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 611.785894] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 611.786154] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 611.787017] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 611.788991] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 611.789208] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 611.789615] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:03:16Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 611.789893] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 611.790082] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 611.790244] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 611.790409] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 611.790661] nova-scheduler[51959]: DEBUG nova.filters [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 611.790874] nova-scheduler[51959]: DEBUG nova.filters [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 611.791102] nova-scheduler[51959]: DEBUG nova.filters [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 611.791313] nova-scheduler[51959]: DEBUG nova.filters [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 611.791482] nova-scheduler[51959]: DEBUG nova.filters [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 611.791646] nova-scheduler[51959]: DEBUG nova.filters [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 611.791837] nova-scheduler[51959]: DEBUG nova.filters [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 611.792016] nova-scheduler[51959]: DEBUG nova.filters [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 611.792405] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 611.792595] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 611.792776] nova-scheduler[51959]: DEBUG nova.scheduler.utils [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Attempting to claim resources in the placement API for instance ec879414-4534-4d0e-a65e-65baff80b16e {{(pid=51959) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 611.810023] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 611.810284] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 611.810437] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 611.817356] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 611.817577] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 611.817746] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 611.820508] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 611.820832] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 611.821225] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:03:16Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 611.822250] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 611.822250] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 611.822250] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 611.822445] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 611.822551] nova-scheduler[51961]: DEBUG nova.filters [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 611.822771] nova-scheduler[51961]: DEBUG nova.filters [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 611.822951] nova-scheduler[51961]: DEBUG nova.filters [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 611.823164] nova-scheduler[51961]: DEBUG nova.filters [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 611.823333] nova-scheduler[51961]: DEBUG nova.filters [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 611.823494] nova-scheduler[51961]: DEBUG nova.filters [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 611.823658] nova-scheduler[51961]: DEBUG nova.filters [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 611.823858] nova-scheduler[51961]: DEBUG nova.filters [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 611.824027] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 611.824201] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 611.824379] nova-scheduler[51961]: DEBUG nova.scheduler.utils [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Attempting to claim resources in the placement API for instance cde76b14-ee01-44c8-8004-39cdf91e9889 {{(pid=51961) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 611.850902] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] [instance: ec879414-4534-4d0e-a65e-65baff80b16e] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51959) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 611.851266] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 611.851468] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 611.851672] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b194fefe-26fd-4f0e-aac8-c4c07268c0cc tempest-ListServerFiltersTestJSON-1556780718 tempest-ListServerFiltersTestJSON-1556780718-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 611.883316] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] [instance: cde76b14-ee01-44c8-8004-39cdf91e9889] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51961) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 611.883878] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 611.884121] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 611.884503] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9954a97c-742a-40d5-b761-9e61e7e7d295 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 612.230945] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Starting to schedule for instances: ['ca732c56-b1d1-40bf-96b6-4b93bc5ff29d'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 612.231273] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 612.231440] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 612.231628] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 612.231888] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 612.232127] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 612.278926] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 612.278926] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 612.278926] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 612.285199] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 612.285199] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 612.285406] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 612.287558] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 612.287809] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 612.288227] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:03:16Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 612.288550] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 612.288771] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 612.288980] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 612.289302] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 612.289601] nova-scheduler[51959]: DEBUG nova.filters [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 612.289962] nova-scheduler[51959]: DEBUG nova.filters [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 612.290158] nova-scheduler[51959]: DEBUG nova.filters [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 612.290407] nova-scheduler[51959]: DEBUG nova.filters [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 612.290622] nova-scheduler[51959]: DEBUG nova.filters [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 612.290831] nova-scheduler[51959]: DEBUG nova.filters [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 612.291057] nova-scheduler[51959]: DEBUG nova.filters [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 612.291366] nova-scheduler[51959]: DEBUG nova.filters [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 612.291572] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 612.291830] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 612.292079] nova-scheduler[51959]: DEBUG nova.scheduler.utils [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Attempting to claim resources in the placement API for instance ca732c56-b1d1-40bf-96b6-4b93bc5ff29d {{(pid=51959) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 612.336861] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] [instance: ca732c56-b1d1-40bf-96b6-4b93bc5ff29d] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51959) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 612.337190] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 612.337402] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 612.337615] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-bba4c956-14a4-4f9e-a55a-3dfb1205b3a3 tempest-ListImageFiltersTestJSON-946347293 tempest-ListImageFiltersTestJSON-946347293-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 615.449353] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Starting to schedule for instances: ['6f0c0004-7fd2-49bf-bb1e-48774c481497'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 615.449714] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 615.449951] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 615.450127] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 615.450609] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 615.450609] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 615.489765] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 615.490088] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 615.490269] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 615.499410] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 615.499410] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 615.499528] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 615.501907] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 615.502141] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 615.502515] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:03:16Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 615.502800] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 615.502973] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 615.503151] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Update host state with instances: ['43ec7ea9-b0a1-4c7f-85a5-1517a2dbf7ee', 'db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 615.503323] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 615.503576] nova-scheduler[51961]: DEBUG nova.filters [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 615.503781] nova-scheduler[51961]: DEBUG nova.filters [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 615.503967] nova-scheduler[51961]: DEBUG nova.filters [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 615.504217] nova-scheduler[51961]: DEBUG nova.filters [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 615.504463] nova-scheduler[51961]: DEBUG nova.filters [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 615.504564] nova-scheduler[51961]: DEBUG nova.filters [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 615.504736] nova-scheduler[51961]: DEBUG nova.filters [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 615.504900] nova-scheduler[51961]: DEBUG nova.filters [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 615.505079] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 615.505318] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 615.505434] nova-scheduler[51961]: DEBUG nova.scheduler.utils [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Attempting to claim resources in the placement API for instance 6f0c0004-7fd2-49bf-bb1e-48774c481497 {{(pid=51961) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 615.566284] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] [instance: 6f0c0004-7fd2-49bf-bb1e-48774c481497] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51961) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 615.566600] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 615.566813] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 615.567038] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-436aab8f-2d4a-47ba-b2c0-250864227759 tempest-TenantUsagesTestJSON-136728812 tempest-TenantUsagesTestJSON-136728812-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.367394] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Starting to schedule for instances: ['0e99d8ab-6b62-4ea9-b7c9-06394fa93e09'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 627.367704] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 627.367916] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 627.368162] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 627.368412] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 627.368977] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 627.413570] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 627.413980] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 627.414226] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.421471] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 627.421726] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 627.422549] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.424735] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 627.424993] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 627.425830] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='2',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_750bcd4b13bb4da9937e127e5abc1201='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_96139b5146b84a968b5a8e9c51ada438='0',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:03:52Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 627.425830] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 627.426357] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 627.426612] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Update host state with instances: ['db1dd823-8349-4f34-9a8e-ecec90bd105b', '4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67', '6874067b-8e9b-4242-9a5f-6312f1484a00'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 627.426833] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.427149] nova-scheduler[51959]: DEBUG nova.filters [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 627.427412] nova-scheduler[51959]: DEBUG nova.filters [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 627.427638] nova-scheduler[51959]: DEBUG nova.filters [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 627.427881] nova-scheduler[51959]: DEBUG nova.filters [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 627.428118] nova-scheduler[51959]: DEBUG nova.filters [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 627.428334] nova-scheduler[51959]: DEBUG nova.filters [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 627.428549] nova-scheduler[51959]: DEBUG nova.filters [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 627.429048] nova-scheduler[51959]: DEBUG nova.filters [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 627.429277] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 627.429504] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 627.429733] nova-scheduler[51959]: DEBUG nova.scheduler.utils [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Attempting to claim resources in the placement API for instance 0e99d8ab-6b62-4ea9-b7c9-06394fa93e09 {{(pid=51959) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 627.478585] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] [instance: 0e99d8ab-6b62-4ea9-b7c9-06394fa93e09] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51959) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 627.483212] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 627.483503] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.005s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 627.483720] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a86eed95-5979-48c1-a329-04be2070467d tempest-ServersTestJSON-1097912379 tempest-ServersTestJSON-1097912379-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 673.450572] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-2af1dcb0-4f01-4977-8208-3c3bfb483fab tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Starting to schedule for instances: ['d0d32dfc-cfcf-42aa-9fd4-5eca9970626c'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 673.450897] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-2af1dcb0-4f01-4977-8208-3c3bfb483fab tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 673.451101] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-2af1dcb0-4f01-4977-8208-3c3bfb483fab tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 673.451252] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-2af1dcb0-4f01-4977-8208-3c3bfb483fab tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 673.451457] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-2af1dcb0-4f01-4977-8208-3c3bfb483fab tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 673.451639] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-2af1dcb0-4f01-4977-8208-3c3bfb483fab tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 673.504149] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-2af1dcb0-4f01-4977-8208-3c3bfb483fab tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 673.504149] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-2af1dcb0-4f01-4977-8208-3c3bfb483fab tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 673.504149] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-2af1dcb0-4f01-4977-8208-3c3bfb483fab tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 673.509348] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-2af1dcb0-4f01-4977-8208-3c3bfb483fab tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 673.509580] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-2af1dcb0-4f01-4977-8208-3c3bfb483fab tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 673.509764] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-2af1dcb0-4f01-4977-8208-3c3bfb483fab tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 673.512691] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-2af1dcb0-4f01-4977-8208-3c3bfb483fab tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 673.513094] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-2af1dcb0-4f01-4977-8208-3c3bfb483fab tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 673.513435] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-2af1dcb0-4f01-4977-8208-3c3bfb483fab tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='3',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_750bcd4b13bb4da9937e127e5abc1201='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='0',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_e13da93f325a4e68ad89ac46dfcb196b='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:04:38Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 673.513747] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-2af1dcb0-4f01-4977-8208-3c3bfb483fab tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 673.514081] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-2af1dcb0-4f01-4977-8208-3c3bfb483fab tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 673.514175] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-2af1dcb0-4f01-4977-8208-3c3bfb483fab tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Update host state with instances: ['4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67', '6874067b-8e9b-4242-9a5f-6312f1484a00', 'f03f507b-364f-41b9-ad33-dcb56ab03317'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 673.514271] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-2af1dcb0-4f01-4977-8208-3c3bfb483fab tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 673.514574] nova-scheduler[51961]: DEBUG nova.filters [None req-2af1dcb0-4f01-4977-8208-3c3bfb483fab tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 673.514872] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-2af1dcb0-4f01-4977-8208-3c3bfb483fab tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:03:25. Elapsed time is 79.377036 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 673.515070] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-2af1dcb0-4f01-4977-8208-3c3bfb483fab tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 673.515229] nova-scheduler[51961]: INFO nova.filters [None req-2af1dcb0-4f01-4977-8208-3c3bfb483fab tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Filter ComputeFilter returned 0 hosts [ 673.515387] nova-scheduler[51961]: DEBUG nova.filters [None req-2af1dcb0-4f01-4977-8208-3c3bfb483fab tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Filtering removed all hosts for the request with instance ID 'd0d32dfc-cfcf-42aa-9fd4-5eca9970626c'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 673.515531] nova-scheduler[51961]: INFO nova.filters [None req-2af1dcb0-4f01-4977-8208-3c3bfb483fab tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Filtering removed all hosts for the request with instance ID 'd0d32dfc-cfcf-42aa-9fd4-5eca9970626c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 673.515685] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-2af1dcb0-4f01-4977-8208-3c3bfb483fab tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 673.515854] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-2af1dcb0-4f01-4977-8208-3c3bfb483fab tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 677.488955] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-b7fef49e-0b83-4d3f-9724-374f5ac2f9f6 tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Starting to schedule for instances: ['08de3c61-c52e-4854-9885-398764470d86'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 677.489970] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-b7fef49e-0b83-4d3f-9724-374f5ac2f9f6 tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 677.490166] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-b7fef49e-0b83-4d3f-9724-374f5ac2f9f6 tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 677.490374] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-b7fef49e-0b83-4d3f-9724-374f5ac2f9f6 tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 677.490600] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-b7fef49e-0b83-4d3f-9724-374f5ac2f9f6 tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 677.490790] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-b7fef49e-0b83-4d3f-9724-374f5ac2f9f6 tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 677.549037] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b7fef49e-0b83-4d3f-9724-374f5ac2f9f6 tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 677.549037] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b7fef49e-0b83-4d3f-9724-374f5ac2f9f6 tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 677.549037] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b7fef49e-0b83-4d3f-9724-374f5ac2f9f6 tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 677.555066] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b7fef49e-0b83-4d3f-9724-374f5ac2f9f6 tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 677.555280] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b7fef49e-0b83-4d3f-9724-374f5ac2f9f6 tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 677.555449] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b7fef49e-0b83-4d3f-9724-374f5ac2f9f6 tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 677.557739] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b7fef49e-0b83-4d3f-9724-374f5ac2f9f6 tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 677.557945] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b7fef49e-0b83-4d3f-9724-374f5ac2f9f6 tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 677.558331] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-b7fef49e-0b83-4d3f-9724-374f5ac2f9f6 tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='3',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_750bcd4b13bb4da9937e127e5abc1201='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='0',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_e13da93f325a4e68ad89ac46dfcb196b='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:04:38Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 677.558618] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-b7fef49e-0b83-4d3f-9724-374f5ac2f9f6 tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 677.558796] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-b7fef49e-0b83-4d3f-9724-374f5ac2f9f6 tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 677.558961] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-b7fef49e-0b83-4d3f-9724-374f5ac2f9f6 tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Update host state with instances: ['4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67', '6874067b-8e9b-4242-9a5f-6312f1484a00', 'f03f507b-364f-41b9-ad33-dcb56ab03317'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 677.559144] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b7fef49e-0b83-4d3f-9724-374f5ac2f9f6 tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 677.559400] nova-scheduler[51959]: DEBUG nova.filters [None req-b7fef49e-0b83-4d3f-9724-374f5ac2f9f6 tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 677.559615] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-b7fef49e-0b83-4d3f-9724-374f5ac2f9f6 tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:03:25. Elapsed time is 83.421856 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 677.559776] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-b7fef49e-0b83-4d3f-9724-374f5ac2f9f6 tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 677.560851] nova-scheduler[51959]: INFO nova.filters [None req-b7fef49e-0b83-4d3f-9724-374f5ac2f9f6 tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Filter ComputeFilter returned 0 hosts [ 677.560851] nova-scheduler[51959]: DEBUG nova.filters [None req-b7fef49e-0b83-4d3f-9724-374f5ac2f9f6 tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Filtering removed all hosts for the request with instance ID '08de3c61-c52e-4854-9885-398764470d86'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 677.560851] nova-scheduler[51959]: INFO nova.filters [None req-b7fef49e-0b83-4d3f-9724-374f5ac2f9f6 tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Filtering removed all hosts for the request with instance ID '08de3c61-c52e-4854-9885-398764470d86'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 677.560851] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-b7fef49e-0b83-4d3f-9724-374f5ac2f9f6 tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 677.560851] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-b7fef49e-0b83-4d3f-9724-374f5ac2f9f6 tempest-ServersTestMultiNic-503120952 tempest-ServersTestMultiNic-503120952-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 685.205456] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-92b27424-bf4f-477d-b634-9f04b700797d tempest-ServerMetadataTestJSON-718186560 tempest-ServerMetadataTestJSON-718186560-project-member] Starting to schedule for instances: ['e983a53d-d557-4710-a58d-4de61a7aafe6'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 685.205764] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-92b27424-bf4f-477d-b634-9f04b700797d tempest-ServerMetadataTestJSON-718186560 tempest-ServerMetadataTestJSON-718186560-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 685.205927] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-92b27424-bf4f-477d-b634-9f04b700797d tempest-ServerMetadataTestJSON-718186560 tempest-ServerMetadataTestJSON-718186560-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 685.206122] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-92b27424-bf4f-477d-b634-9f04b700797d tempest-ServerMetadataTestJSON-718186560 tempest-ServerMetadataTestJSON-718186560-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 685.206323] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-92b27424-bf4f-477d-b634-9f04b700797d tempest-ServerMetadataTestJSON-718186560 tempest-ServerMetadataTestJSON-718186560-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 685.206507] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-92b27424-bf4f-477d-b634-9f04b700797d tempest-ServerMetadataTestJSON-718186560 tempest-ServerMetadataTestJSON-718186560-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 685.253128] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-92b27424-bf4f-477d-b634-9f04b700797d tempest-ServerMetadataTestJSON-718186560 tempest-ServerMetadataTestJSON-718186560-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 685.253344] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-92b27424-bf4f-477d-b634-9f04b700797d tempest-ServerMetadataTestJSON-718186560 tempest-ServerMetadataTestJSON-718186560-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 685.253549] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-92b27424-bf4f-477d-b634-9f04b700797d tempest-ServerMetadataTestJSON-718186560 tempest-ServerMetadataTestJSON-718186560-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 685.260725] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-92b27424-bf4f-477d-b634-9f04b700797d tempest-ServerMetadataTestJSON-718186560 tempest-ServerMetadataTestJSON-718186560-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 685.260938] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-92b27424-bf4f-477d-b634-9f04b700797d tempest-ServerMetadataTestJSON-718186560 tempest-ServerMetadataTestJSON-718186560-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 685.261122] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-92b27424-bf4f-477d-b634-9f04b700797d tempest-ServerMetadataTestJSON-718186560 tempest-ServerMetadataTestJSON-718186560-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 685.263343] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-92b27424-bf4f-477d-b634-9f04b700797d tempest-ServerMetadataTestJSON-718186560 tempest-ServerMetadataTestJSON-718186560-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 685.263579] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-92b27424-bf4f-477d-b634-9f04b700797d tempest-ServerMetadataTestJSON-718186560 tempest-ServerMetadataTestJSON-718186560-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 685.263971] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-92b27424-bf4f-477d-b634-9f04b700797d tempest-ServerMetadataTestJSON-718186560 tempest-ServerMetadataTestJSON-718186560-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='3',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_750bcd4b13bb4da9937e127e5abc1201='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='0',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_e13da93f325a4e68ad89ac46dfcb196b='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:04:38Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 685.264682] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-92b27424-bf4f-477d-b634-9f04b700797d tempest-ServerMetadataTestJSON-718186560 tempest-ServerMetadataTestJSON-718186560-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 685.264682] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-92b27424-bf4f-477d-b634-9f04b700797d tempest-ServerMetadataTestJSON-718186560 tempest-ServerMetadataTestJSON-718186560-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 685.264682] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-92b27424-bf4f-477d-b634-9f04b700797d tempest-ServerMetadataTestJSON-718186560 tempest-ServerMetadataTestJSON-718186560-project-member] Update host state with instances: ['4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67', '6874067b-8e9b-4242-9a5f-6312f1484a00', 'f03f507b-364f-41b9-ad33-dcb56ab03317'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 685.264897] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-92b27424-bf4f-477d-b634-9f04b700797d tempest-ServerMetadataTestJSON-718186560 tempest-ServerMetadataTestJSON-718186560-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 685.265034] nova-scheduler[51961]: DEBUG nova.filters [None req-92b27424-bf4f-477d-b634-9f04b700797d tempest-ServerMetadataTestJSON-718186560 tempest-ServerMetadataTestJSON-718186560-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 685.265258] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-92b27424-bf4f-477d-b634-9f04b700797d tempest-ServerMetadataTestJSON-718186560 tempest-ServerMetadataTestJSON-718186560-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:03:25. Elapsed time is 91.127489 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 685.265419] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-92b27424-bf4f-477d-b634-9f04b700797d tempest-ServerMetadataTestJSON-718186560 tempest-ServerMetadataTestJSON-718186560-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 685.265580] nova-scheduler[51961]: INFO nova.filters [None req-92b27424-bf4f-477d-b634-9f04b700797d tempest-ServerMetadataTestJSON-718186560 tempest-ServerMetadataTestJSON-718186560-project-member] Filter ComputeFilter returned 0 hosts [ 685.265765] nova-scheduler[51961]: DEBUG nova.filters [None req-92b27424-bf4f-477d-b634-9f04b700797d tempest-ServerMetadataTestJSON-718186560 tempest-ServerMetadataTestJSON-718186560-project-member] Filtering removed all hosts for the request with instance ID 'e983a53d-d557-4710-a58d-4de61a7aafe6'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 685.265918] nova-scheduler[51961]: INFO nova.filters [None req-92b27424-bf4f-477d-b634-9f04b700797d tempest-ServerMetadataTestJSON-718186560 tempest-ServerMetadataTestJSON-718186560-project-member] Filtering removed all hosts for the request with instance ID 'e983a53d-d557-4710-a58d-4de61a7aafe6'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 685.266241] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-92b27424-bf4f-477d-b634-9f04b700797d tempest-ServerMetadataTestJSON-718186560 tempest-ServerMetadataTestJSON-718186560-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 685.266438] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-92b27424-bf4f-477d-b634-9f04b700797d tempest-ServerMetadataTestJSON-718186560 tempest-ServerMetadataTestJSON-718186560-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 689.251263] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-0050b230-bf0a-4903-9996-79885a3b2d87 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Starting to schedule for instances: ['4fe80c68-c78f-48fc-9537-d1950cab6887'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 689.251579] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-0050b230-bf0a-4903-9996-79885a3b2d87 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 689.251746] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-0050b230-bf0a-4903-9996-79885a3b2d87 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 689.251940] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-0050b230-bf0a-4903-9996-79885a3b2d87 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 689.252153] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-0050b230-bf0a-4903-9996-79885a3b2d87 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 689.252342] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-0050b230-bf0a-4903-9996-79885a3b2d87 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 689.294190] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0050b230-bf0a-4903-9996-79885a3b2d87 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 689.294430] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0050b230-bf0a-4903-9996-79885a3b2d87 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 689.294604] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0050b230-bf0a-4903-9996-79885a3b2d87 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 689.301361] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0050b230-bf0a-4903-9996-79885a3b2d87 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 689.301544] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0050b230-bf0a-4903-9996-79885a3b2d87 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 689.301713] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0050b230-bf0a-4903-9996-79885a3b2d87 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 689.303950] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0050b230-bf0a-4903-9996-79885a3b2d87 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 689.304300] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0050b230-bf0a-4903-9996-79885a3b2d87 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 689.304521] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-0050b230-bf0a-4903-9996-79885a3b2d87 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='3',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_750bcd4b13bb4da9937e127e5abc1201='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='0',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_e13da93f325a4e68ad89ac46dfcb196b='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:04:38Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 689.304802] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-0050b230-bf0a-4903-9996-79885a3b2d87 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 689.304976] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-0050b230-bf0a-4903-9996-79885a3b2d87 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 689.305154] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-0050b230-bf0a-4903-9996-79885a3b2d87 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Update host state with instances: ['4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67', '6874067b-8e9b-4242-9a5f-6312f1484a00', 'f03f507b-364f-41b9-ad33-dcb56ab03317'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 689.305320] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0050b230-bf0a-4903-9996-79885a3b2d87 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 689.305614] nova-scheduler[51959]: DEBUG nova.filters [None req-0050b230-bf0a-4903-9996-79885a3b2d87 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 689.305946] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-0050b230-bf0a-4903-9996-79885a3b2d87 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:03:25. Elapsed time is 95.168085 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 689.306202] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-0050b230-bf0a-4903-9996-79885a3b2d87 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 689.306465] nova-scheduler[51959]: INFO nova.filters [None req-0050b230-bf0a-4903-9996-79885a3b2d87 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Filter ComputeFilter returned 0 hosts [ 689.306725] nova-scheduler[51959]: DEBUG nova.filters [None req-0050b230-bf0a-4903-9996-79885a3b2d87 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Filtering removed all hosts for the request with instance ID '4fe80c68-c78f-48fc-9537-d1950cab6887'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 689.306974] nova-scheduler[51959]: INFO nova.filters [None req-0050b230-bf0a-4903-9996-79885a3b2d87 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Filtering removed all hosts for the request with instance ID '4fe80c68-c78f-48fc-9537-d1950cab6887'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 689.307248] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-0050b230-bf0a-4903-9996-79885a3b2d87 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 689.307499] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-0050b230-bf0a-4903-9996-79885a3b2d87 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 689.477256] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-4bf148ca-50ca-4902-b828-5f90b0072f40 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Starting to schedule for instances: ['074bfa3a-f3ba-45a0-80a0-62f40bd7031f'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 689.477497] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-4bf148ca-50ca-4902-b828-5f90b0072f40 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 689.477752] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-4bf148ca-50ca-4902-b828-5f90b0072f40 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 689.477961] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-4bf148ca-50ca-4902-b828-5f90b0072f40 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 689.478183] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-4bf148ca-50ca-4902-b828-5f90b0072f40 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 689.478372] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-4bf148ca-50ca-4902-b828-5f90b0072f40 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 689.518278] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-4bf148ca-50ca-4902-b828-5f90b0072f40 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 689.519152] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-4bf148ca-50ca-4902-b828-5f90b0072f40 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 689.519152] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-4bf148ca-50ca-4902-b828-5f90b0072f40 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 689.525748] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-4bf148ca-50ca-4902-b828-5f90b0072f40 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 689.525954] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-4bf148ca-50ca-4902-b828-5f90b0072f40 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 689.526142] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-4bf148ca-50ca-4902-b828-5f90b0072f40 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 689.528370] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-4bf148ca-50ca-4902-b828-5f90b0072f40 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 689.528616] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-4bf148ca-50ca-4902-b828-5f90b0072f40 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 689.528988] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-4bf148ca-50ca-4902-b828-5f90b0072f40 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='3',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_750bcd4b13bb4da9937e127e5abc1201='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_a8331e6e26314ee3bd30dd7f6494daf4='0',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_e13da93f325a4e68ad89ac46dfcb196b='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:04:38Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 689.529292] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-4bf148ca-50ca-4902-b828-5f90b0072f40 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 689.529467] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-4bf148ca-50ca-4902-b828-5f90b0072f40 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 3, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 689.529635] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-4bf148ca-50ca-4902-b828-5f90b0072f40 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Update host state with instances: ['4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', '23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67', '6874067b-8e9b-4242-9a5f-6312f1484a00', 'f03f507b-364f-41b9-ad33-dcb56ab03317'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 689.529805] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-4bf148ca-50ca-4902-b828-5f90b0072f40 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 689.530070] nova-scheduler[51961]: DEBUG nova.filters [None req-4bf148ca-50ca-4902-b828-5f90b0072f40 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 689.530284] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-4bf148ca-50ca-4902-b828-5f90b0072f40 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:03:25. Elapsed time is 95.392523 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 689.530449] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-4bf148ca-50ca-4902-b828-5f90b0072f40 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 689.530611] nova-scheduler[51961]: INFO nova.filters [None req-4bf148ca-50ca-4902-b828-5f90b0072f40 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Filter ComputeFilter returned 0 hosts [ 689.530765] nova-scheduler[51961]: DEBUG nova.filters [None req-4bf148ca-50ca-4902-b828-5f90b0072f40 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Filtering removed all hosts for the request with instance ID '074bfa3a-f3ba-45a0-80a0-62f40bd7031f'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 689.530907] nova-scheduler[51961]: INFO nova.filters [None req-4bf148ca-50ca-4902-b828-5f90b0072f40 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Filtering removed all hosts for the request with instance ID '074bfa3a-f3ba-45a0-80a0-62f40bd7031f'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 689.531076] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-4bf148ca-50ca-4902-b828-5f90b0072f40 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 689.531231] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-4bf148ca-50ca-4902-b828-5f90b0072f40 tempest-ServerShowV247Test-1614233829 tempest-ServerShowV247Test-1614233829-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 706.035506] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-cb882178-dd1b-4b7c-bfb9-dd54312e456f None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 706.035720] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-cb882178-dd1b-4b7c-bfb9-dd54312e456f None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 706.035885] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-cb882178-dd1b-4b7c-bfb9-dd54312e456f None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 706.036049] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-cb882178-dd1b-4b7c-bfb9-dd54312e456f None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 706.036238] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-cb882178-dd1b-4b7c-bfb9-dd54312e456f None None] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 706.036385] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-cb882178-dd1b-4b7c-bfb9-dd54312e456f None None] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 706.036580] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-cb882178-dd1b-4b7c-bfb9-dd54312e456f None None] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 706.036731] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-cb882178-dd1b-4b7c-bfb9-dd54312e456f None None] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 706.036931] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-cb882178-dd1b-4b7c-bfb9-dd54312e456f None None] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 706.037106] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-cb882178-dd1b-4b7c-bfb9-dd54312e456f None None] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 706.039921] nova-scheduler[51961]: INFO nova.scheduler.host_manager [None req-cb882178-dd1b-4b7c-bfb9-dd54312e456f None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 706.040089] nova-scheduler[51959]: INFO nova.scheduler.host_manager [None req-cb882178-dd1b-4b7c-bfb9-dd54312e456f None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 706.040241] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-cb882178-dd1b-4b7c-bfb9-dd54312e456f None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.004s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 706.040445] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-cb882178-dd1b-4b7c-bfb9-dd54312e456f None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.005s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 715.514112] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Starting to schedule for instances: ['e84f3fe9-d377-4018-8874-972d1f888208'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 715.514832] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 715.515148] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 715.515460] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 715.516185] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 715.516185] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 715.543179] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Starting to schedule for instances: ['0d87148b-1493-4777-a8b3-b94a64e8eca6'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 715.543510] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 715.543674] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 715.543861] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 715.544080] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 715.545389] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 715.575452] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 715.575663] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 715.575841] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 715.583667] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 715.583926] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 715.584803] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 715.586897] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 715.587123] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 715.587577] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='4',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_750bcd4b13bb4da9937e127e5abc1201='1',num_proj_75310bd38faf4daea1ed2e141769a330='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='0',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_e13da93f325a4e68ad89ac46dfcb196b='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:05:25Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 715.587874] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 715.588066] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 715.588237] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Update host state with instances: ['23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67', '6874067b-8e9b-4242-9a5f-6312f1484a00', 'f03f507b-364f-41b9-ad33-dcb56ab03317', 'ea4a243b-481f-421d-ba29-c88c828f754e'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 715.588408] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 715.588667] nova-scheduler[51959]: DEBUG nova.filters [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 715.588878] nova-scheduler[51959]: DEBUG nova.filters [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.589082] nova-scheduler[51959]: DEBUG nova.filters [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.589294] nova-scheduler[51959]: DEBUG nova.filters [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.589470] nova-scheduler[51959]: DEBUG nova.filters [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.589637] nova-scheduler[51959]: DEBUG nova.filters [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.589809] nova-scheduler[51959]: DEBUG nova.filters [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.589980] nova-scheduler[51959]: DEBUG nova.filters [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.590709] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 715.590709] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 715.590709] nova-scheduler[51959]: DEBUG nova.scheduler.utils [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Attempting to claim resources in the placement API for instance e84f3fe9-d377-4018-8874-972d1f888208 {{(pid=51959) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 715.591438] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 715.591679] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 715.591853] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 715.598340] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 715.598540] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 715.599407] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 715.601038] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 715.601139] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 715.601485] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='4',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_750bcd4b13bb4da9937e127e5abc1201='1',num_proj_75310bd38faf4daea1ed2e141769a330='1',num_proj_7913858bdbbe4375917c0e1864ee8d2e='0',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_e13da93f325a4e68ad89ac46dfcb196b='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:05:25Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 715.601758] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 715.602392] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 715.602392] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Update host state with instances: ['23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67', '6874067b-8e9b-4242-9a5f-6312f1484a00', 'f03f507b-364f-41b9-ad33-dcb56ab03317', 'ea4a243b-481f-421d-ba29-c88c828f754e'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 715.602392] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 715.602656] nova-scheduler[51961]: DEBUG nova.filters [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 715.602688] nova-scheduler[51961]: DEBUG nova.filters [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.602957] nova-scheduler[51961]: DEBUG nova.filters [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.603147] nova-scheduler[51961]: DEBUG nova.filters [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.603324] nova-scheduler[51961]: DEBUG nova.filters [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.603492] nova-scheduler[51961]: DEBUG nova.filters [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.603662] nova-scheduler[51961]: DEBUG nova.filters [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.603851] nova-scheduler[51961]: DEBUG nova.filters [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.604037] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 715.604214] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 715.604397] nova-scheduler[51961]: DEBUG nova.scheduler.utils [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Attempting to claim resources in the placement API for instance 0d87148b-1493-4777-a8b3-b94a64e8eca6 {{(pid=51961) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 715.648317] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] [instance: e84f3fe9-d377-4018-8874-972d1f888208] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51959) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 715.648888] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 715.648888] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 715.649087] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0ecb6f04-3d6b-4fb2-8c9c-5c2bb133595f tempest-DeleteServersAdminTestJSON-409634133 tempest-DeleteServersAdminTestJSON-409634133-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 715.669593] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] [instance: 0d87148b-1493-4777-a8b3-b94a64e8eca6] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51961) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 715.669911] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 715.670141] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 715.670356] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-838c9fd1-fd9b-4dda-9994-246915d158d5 tempest-MigrationsAdminTest-2016093575 tempest-MigrationsAdminTest-2016093575-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 794.375384] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-a279e742-0644-4d61-be51-870e83cd9176 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Starting to schedule for instances: ['762267db-4b69-48a1-87c0-dca716b3679c'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 794.376019] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-a279e742-0644-4d61-be51-870e83cd9176 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 794.376215] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-a279e742-0644-4d61-be51-870e83cd9176 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 794.376409] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-a279e742-0644-4d61-be51-870e83cd9176 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 794.376620] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-a279e742-0644-4d61-be51-870e83cd9176 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 794.376818] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-a279e742-0644-4d61-be51-870e83cd9176 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 794.419170] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a279e742-0644-4d61-be51-870e83cd9176 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 794.419426] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a279e742-0644-4d61-be51-870e83cd9176 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 794.419704] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a279e742-0644-4d61-be51-870e83cd9176 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 794.427026] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a279e742-0644-4d61-be51-870e83cd9176 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 794.427026] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a279e742-0644-4d61-be51-870e83cd9176 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 794.427206] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a279e742-0644-4d61-be51-870e83cd9176 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 794.429462] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a279e742-0644-4d61-be51-870e83cd9176 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 794.429671] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a279e742-0644-4d61-be51-870e83cd9176 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 794.430050] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-a279e742-0644-4d61-be51-870e83cd9176 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='5',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_6caa6881daf74a08b946fafd73ae022e='1',num_proj_750bcd4b13bb4da9937e127e5abc1201='1',num_proj_75310bd38faf4daea1ed2e141769a330='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_e13da93f325a4e68ad89ac46dfcb196b='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_deleting='6',num_task_spawning='4',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:06:20Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 794.430346] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-a279e742-0644-4d61-be51-870e83cd9176 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 794.430521] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-a279e742-0644-4d61-be51-870e83cd9176 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 794.430717] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-a279e742-0644-4d61-be51-870e83cd9176 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state with instances: ['23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67', 'f03f507b-364f-41b9-ad33-dcb56ab03317', 'ea4a243b-481f-421d-ba29-c88c828f754e', 'df997589-61b6-4f68-9169-e6f9bee650c7'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 794.430847] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a279e742-0644-4d61-be51-870e83cd9176 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 794.431121] nova-scheduler[51959]: DEBUG nova.filters [None req-a279e742-0644-4d61-be51-870e83cd9176 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 794.431322] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-a279e742-0644-4d61-be51-870e83cd9176 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:05:25. Elapsed time is 80.293561 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 794.431510] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-a279e742-0644-4d61-be51-870e83cd9176 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 794.431869] nova-scheduler[51959]: INFO nova.filters [None req-a279e742-0644-4d61-be51-870e83cd9176 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filter ComputeFilter returned 0 hosts [ 794.432014] nova-scheduler[51959]: DEBUG nova.filters [None req-a279e742-0644-4d61-be51-870e83cd9176 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filtering removed all hosts for the request with instance ID '762267db-4b69-48a1-87c0-dca716b3679c'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 794.432171] nova-scheduler[51959]: INFO nova.filters [None req-a279e742-0644-4d61-be51-870e83cd9176 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filtering removed all hosts for the request with instance ID '762267db-4b69-48a1-87c0-dca716b3679c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 794.432326] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-a279e742-0644-4d61-be51-870e83cd9176 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 794.432489] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-a279e742-0644-4d61-be51-870e83cd9176 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 796.212809] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-5425c8bf-e4b9-489a-915a-344efe53fc17 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Starting to schedule for instances: ['bf498dcd-5a65-4fc2-9f4c-9bfe75db8ae0'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 796.213300] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-5425c8bf-e4b9-489a-915a-344efe53fc17 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 796.213539] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-5425c8bf-e4b9-489a-915a-344efe53fc17 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 796.213745] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-5425c8bf-e4b9-489a-915a-344efe53fc17 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 796.213952] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-5425c8bf-e4b9-489a-915a-344efe53fc17 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 796.214153] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-5425c8bf-e4b9-489a-915a-344efe53fc17 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 796.254284] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-5425c8bf-e4b9-489a-915a-344efe53fc17 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 796.254507] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-5425c8bf-e4b9-489a-915a-344efe53fc17 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 796.254710] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-5425c8bf-e4b9-489a-915a-344efe53fc17 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 796.261638] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-5425c8bf-e4b9-489a-915a-344efe53fc17 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 796.261886] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-5425c8bf-e4b9-489a-915a-344efe53fc17 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 796.262083] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-5425c8bf-e4b9-489a-915a-344efe53fc17 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 796.264272] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-5425c8bf-e4b9-489a-915a-344efe53fc17 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 796.264417] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-5425c8bf-e4b9-489a-915a-344efe53fc17 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 796.264761] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-5425c8bf-e4b9-489a-915a-344efe53fc17 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='5',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_6caa6881daf74a08b946fafd73ae022e='1',num_proj_750bcd4b13bb4da9937e127e5abc1201='1',num_proj_75310bd38faf4daea1ed2e141769a330='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_e13da93f325a4e68ad89ac46dfcb196b='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_deleting='6',num_task_spawning='4',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:06:20Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 796.265074] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-5425c8bf-e4b9-489a-915a-344efe53fc17 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 796.265301] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-5425c8bf-e4b9-489a-915a-344efe53fc17 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 796.265479] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-5425c8bf-e4b9-489a-915a-344efe53fc17 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state with instances: ['23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67', 'f03f507b-364f-41b9-ad33-dcb56ab03317', 'ea4a243b-481f-421d-ba29-c88c828f754e', 'df997589-61b6-4f68-9169-e6f9bee650c7'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 796.265681] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-5425c8bf-e4b9-489a-915a-344efe53fc17 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 796.265946] nova-scheduler[51961]: DEBUG nova.filters [None req-5425c8bf-e4b9-489a-915a-344efe53fc17 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 796.266176] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-5425c8bf-e4b9-489a-915a-344efe53fc17 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:05:25. Elapsed time is 82.128398 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 796.266337] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-5425c8bf-e4b9-489a-915a-344efe53fc17 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 796.266500] nova-scheduler[51961]: INFO nova.filters [None req-5425c8bf-e4b9-489a-915a-344efe53fc17 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filter ComputeFilter returned 0 hosts [ 796.266665] nova-scheduler[51961]: DEBUG nova.filters [None req-5425c8bf-e4b9-489a-915a-344efe53fc17 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filtering removed all hosts for the request with instance ID 'bf498dcd-5a65-4fc2-9f4c-9bfe75db8ae0'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 796.266879] nova-scheduler[51961]: INFO nova.filters [None req-5425c8bf-e4b9-489a-915a-344efe53fc17 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filtering removed all hosts for the request with instance ID 'bf498dcd-5a65-4fc2-9f4c-9bfe75db8ae0'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 796.267190] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-5425c8bf-e4b9-489a-915a-344efe53fc17 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 796.267391] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-5425c8bf-e4b9-489a-915a-344efe53fc17 tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 798.074403] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-84ce00ea-efa7-42e6-aa14-649a395731ae tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Starting to schedule for instances: ['2b979b25-32ec-4c37-92bc-9ceb0765d8ae'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 798.074738] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-84ce00ea-efa7-42e6-aa14-649a395731ae tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 798.074908] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-84ce00ea-efa7-42e6-aa14-649a395731ae tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 798.075106] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-84ce00ea-efa7-42e6-aa14-649a395731ae tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 798.075306] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-84ce00ea-efa7-42e6-aa14-649a395731ae tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 798.075488] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-84ce00ea-efa7-42e6-aa14-649a395731ae tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 798.115709] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-84ce00ea-efa7-42e6-aa14-649a395731ae tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 798.115934] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-84ce00ea-efa7-42e6-aa14-649a395731ae tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 798.116122] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-84ce00ea-efa7-42e6-aa14-649a395731ae tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 798.122638] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-84ce00ea-efa7-42e6-aa14-649a395731ae tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 798.122852] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-84ce00ea-efa7-42e6-aa14-649a395731ae tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 798.123030] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-84ce00ea-efa7-42e6-aa14-649a395731ae tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 798.125150] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-84ce00ea-efa7-42e6-aa14-649a395731ae tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 798.125362] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-84ce00ea-efa7-42e6-aa14-649a395731ae tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 798.125729] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-84ce00ea-efa7-42e6-aa14-649a395731ae tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='5',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_6caa6881daf74a08b946fafd73ae022e='1',num_proj_750bcd4b13bb4da9937e127e5abc1201='1',num_proj_75310bd38faf4daea1ed2e141769a330='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_e13da93f325a4e68ad89ac46dfcb196b='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_deleting='6',num_task_spawning='4',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:06:20Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 798.126015] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-84ce00ea-efa7-42e6-aa14-649a395731ae tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 798.126191] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-84ce00ea-efa7-42e6-aa14-649a395731ae tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 798.126352] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-84ce00ea-efa7-42e6-aa14-649a395731ae tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Update host state with instances: ['23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67', 'f03f507b-364f-41b9-ad33-dcb56ab03317', 'ea4a243b-481f-421d-ba29-c88c828f754e', 'df997589-61b6-4f68-9169-e6f9bee650c7'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 798.126517] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-84ce00ea-efa7-42e6-aa14-649a395731ae tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 798.126761] nova-scheduler[51959]: DEBUG nova.filters [None req-84ce00ea-efa7-42e6-aa14-649a395731ae tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 798.126970] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-84ce00ea-efa7-42e6-aa14-649a395731ae tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:05:25. Elapsed time is 83.989214 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 798.127140] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-84ce00ea-efa7-42e6-aa14-649a395731ae tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 798.127297] nova-scheduler[51959]: INFO nova.filters [None req-84ce00ea-efa7-42e6-aa14-649a395731ae tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filter ComputeFilter returned 0 hosts [ 798.127924] nova-scheduler[51959]: DEBUG nova.filters [None req-84ce00ea-efa7-42e6-aa14-649a395731ae tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filtering removed all hosts for the request with instance ID '2b979b25-32ec-4c37-92bc-9ceb0765d8ae'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 798.127924] nova-scheduler[51959]: INFO nova.filters [None req-84ce00ea-efa7-42e6-aa14-649a395731ae tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filtering removed all hosts for the request with instance ID '2b979b25-32ec-4c37-92bc-9ceb0765d8ae'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 798.127924] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-84ce00ea-efa7-42e6-aa14-649a395731ae tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 798.128097] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-84ce00ea-efa7-42e6-aa14-649a395731ae tempest-DeleteServersTestJSON-478355548 tempest-DeleteServersTestJSON-478355548-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 804.946280] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-91522dda-f2c2-420e-af40-182248369446 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Starting to schedule for instances: ['7af53c7d-ab29-4473-b1bf-79afabc1a32d'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 804.946280] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-91522dda-f2c2-420e-af40-182248369446 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 804.946657] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-91522dda-f2c2-420e-af40-182248369446 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 804.946657] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-91522dda-f2c2-420e-af40-182248369446 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 804.946814] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-91522dda-f2c2-420e-af40-182248369446 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 804.946956] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-91522dda-f2c2-420e-af40-182248369446 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 805.010259] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-91522dda-f2c2-420e-af40-182248369446 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 805.011263] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-91522dda-f2c2-420e-af40-182248369446 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 805.011510] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-91522dda-f2c2-420e-af40-182248369446 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 805.022796] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-91522dda-f2c2-420e-af40-182248369446 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 805.023094] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-91522dda-f2c2-420e-af40-182248369446 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 805.023316] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-91522dda-f2c2-420e-af40-182248369446 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 805.026290] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-91522dda-f2c2-420e-af40-182248369446 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 805.027300] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-91522dda-f2c2-420e-af40-182248369446 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 805.027300] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-91522dda-f2c2-420e-af40-182248369446 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='5',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_6caa6881daf74a08b946fafd73ae022e='1',num_proj_750bcd4b13bb4da9937e127e5abc1201='1',num_proj_75310bd38faf4daea1ed2e141769a330='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_e13da93f325a4e68ad89ac46dfcb196b='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_deleting='6',num_task_spawning='4',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:06:20Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 805.027300] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-91522dda-f2c2-420e-af40-182248369446 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 805.027707] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-91522dda-f2c2-420e-af40-182248369446 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 805.027767] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-91522dda-f2c2-420e-af40-182248369446 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state with instances: ['23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 805.027997] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-91522dda-f2c2-420e-af40-182248369446 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 805.028318] nova-scheduler[51961]: DEBUG nova.filters [None req-91522dda-f2c2-420e-af40-182248369446 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 805.028568] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-91522dda-f2c2-420e-af40-182248369446 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:05:25. Elapsed time is 90.890793 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 805.029509] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-91522dda-f2c2-420e-af40-182248369446 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 805.029509] nova-scheduler[51961]: INFO nova.filters [None req-91522dda-f2c2-420e-af40-182248369446 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filter ComputeFilter returned 0 hosts [ 805.029509] nova-scheduler[51961]: DEBUG nova.filters [None req-91522dda-f2c2-420e-af40-182248369446 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filtering removed all hosts for the request with instance ID '7af53c7d-ab29-4473-b1bf-79afabc1a32d'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 805.029509] nova-scheduler[51961]: INFO nova.filters [None req-91522dda-f2c2-420e-af40-182248369446 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filtering removed all hosts for the request with instance ID '7af53c7d-ab29-4473-b1bf-79afabc1a32d'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 805.029509] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-91522dda-f2c2-420e-af40-182248369446 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 805.030079] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-91522dda-f2c2-420e-af40-182248369446 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 806.979239] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-57b5a771-75d8-4517-8b37-df3dfc2cbbe9 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Starting to schedule for instances: ['870a683b-06a3-4dcb-a65f-ef4c14227225'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 806.979938] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-57b5a771-75d8-4517-8b37-df3dfc2cbbe9 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 806.980244] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-57b5a771-75d8-4517-8b37-df3dfc2cbbe9 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 806.980602] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-57b5a771-75d8-4517-8b37-df3dfc2cbbe9 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 806.980939] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-57b5a771-75d8-4517-8b37-df3dfc2cbbe9 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 806.981273] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-57b5a771-75d8-4517-8b37-df3dfc2cbbe9 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 807.042846] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-57b5a771-75d8-4517-8b37-df3dfc2cbbe9 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 807.042846] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-57b5a771-75d8-4517-8b37-df3dfc2cbbe9 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 807.042846] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-57b5a771-75d8-4517-8b37-df3dfc2cbbe9 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 807.066734] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-57b5a771-75d8-4517-8b37-df3dfc2cbbe9 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 807.066924] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-57b5a771-75d8-4517-8b37-df3dfc2cbbe9 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 807.068439] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-57b5a771-75d8-4517-8b37-df3dfc2cbbe9 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 807.070407] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-57b5a771-75d8-4517-8b37-df3dfc2cbbe9 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 807.070407] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-57b5a771-75d8-4517-8b37-df3dfc2cbbe9 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 807.070795] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-57b5a771-75d8-4517-8b37-df3dfc2cbbe9 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='5',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_6caa6881daf74a08b946fafd73ae022e='1',num_proj_750bcd4b13bb4da9937e127e5abc1201='1',num_proj_75310bd38faf4daea1ed2e141769a330='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_e13da93f325a4e68ad89ac46dfcb196b='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_deleting='6',num_task_spawning='4',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:06:20Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 807.071980] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-57b5a771-75d8-4517-8b37-df3dfc2cbbe9 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 807.071980] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-57b5a771-75d8-4517-8b37-df3dfc2cbbe9 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 807.072224] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-57b5a771-75d8-4517-8b37-df3dfc2cbbe9 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Update host state with instances: ['23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 807.072314] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-57b5a771-75d8-4517-8b37-df3dfc2cbbe9 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 807.072578] nova-scheduler[51959]: DEBUG nova.filters [None req-57b5a771-75d8-4517-8b37-df3dfc2cbbe9 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 807.074114] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-57b5a771-75d8-4517-8b37-df3dfc2cbbe9 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:05:25. Elapsed time is 92.935074 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 807.074114] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-57b5a771-75d8-4517-8b37-df3dfc2cbbe9 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 807.074114] nova-scheduler[51959]: INFO nova.filters [None req-57b5a771-75d8-4517-8b37-df3dfc2cbbe9 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Filter ComputeFilter returned 0 hosts [ 807.074114] nova-scheduler[51959]: DEBUG nova.filters [None req-57b5a771-75d8-4517-8b37-df3dfc2cbbe9 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Filtering removed all hosts for the request with instance ID '870a683b-06a3-4dcb-a65f-ef4c14227225'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 807.074114] nova-scheduler[51959]: INFO nova.filters [None req-57b5a771-75d8-4517-8b37-df3dfc2cbbe9 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Filtering removed all hosts for the request with instance ID '870a683b-06a3-4dcb-a65f-ef4c14227225'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 807.074114] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-57b5a771-75d8-4517-8b37-df3dfc2cbbe9 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 807.074114] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-57b5a771-75d8-4517-8b37-df3dfc2cbbe9 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 807.156675] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-f5a6a27d-a1f5-4982-8ad6-9d4c9bd70a63 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Starting to schedule for instances: ['c1652426-1d30-4f07-919a-bef9875c9e85'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 807.156675] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-f5a6a27d-a1f5-4982-8ad6-9d4c9bd70a63 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 807.156675] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-f5a6a27d-a1f5-4982-8ad6-9d4c9bd70a63 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 807.158884] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-f5a6a27d-a1f5-4982-8ad6-9d4c9bd70a63 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 807.159115] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-f5a6a27d-a1f5-4982-8ad6-9d4c9bd70a63 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 807.159306] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-f5a6a27d-a1f5-4982-8ad6-9d4c9bd70a63 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 807.213901] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-f5a6a27d-a1f5-4982-8ad6-9d4c9bd70a63 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 807.213901] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-f5a6a27d-a1f5-4982-8ad6-9d4c9bd70a63 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 807.213901] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-f5a6a27d-a1f5-4982-8ad6-9d4c9bd70a63 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 807.219834] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-f5a6a27d-a1f5-4982-8ad6-9d4c9bd70a63 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 807.220056] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-f5a6a27d-a1f5-4982-8ad6-9d4c9bd70a63 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 807.220223] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-f5a6a27d-a1f5-4982-8ad6-9d4c9bd70a63 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 807.222516] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-f5a6a27d-a1f5-4982-8ad6-9d4c9bd70a63 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 807.222745] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-f5a6a27d-a1f5-4982-8ad6-9d4c9bd70a63 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 807.223121] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-f5a6a27d-a1f5-4982-8ad6-9d4c9bd70a63 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='5',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='1',num_proj_6caa6881daf74a08b946fafd73ae022e='1',num_proj_750bcd4b13bb4da9937e127e5abc1201='1',num_proj_75310bd38faf4daea1ed2e141769a330='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_e13da93f325a4e68ad89ac46dfcb196b='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_deleting='6',num_task_spawning='4',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:06:20Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 807.223407] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-f5a6a27d-a1f5-4982-8ad6-9d4c9bd70a63 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 807.223587] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-f5a6a27d-a1f5-4982-8ad6-9d4c9bd70a63 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 807.223745] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-f5a6a27d-a1f5-4982-8ad6-9d4c9bd70a63 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state with instances: ['23984fc7-95de-43c3-a21e-894fab241dce', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 807.223902] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-f5a6a27d-a1f5-4982-8ad6-9d4c9bd70a63 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 807.224192] nova-scheduler[51961]: DEBUG nova.filters [None req-f5a6a27d-a1f5-4982-8ad6-9d4c9bd70a63 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 807.224426] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-f5a6a27d-a1f5-4982-8ad6-9d4c9bd70a63 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:05:25. Elapsed time is 93.086652 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 807.224580] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-f5a6a27d-a1f5-4982-8ad6-9d4c9bd70a63 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 807.224796] nova-scheduler[51961]: INFO nova.filters [None req-f5a6a27d-a1f5-4982-8ad6-9d4c9bd70a63 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filter ComputeFilter returned 0 hosts [ 807.224876] nova-scheduler[51961]: DEBUG nova.filters [None req-f5a6a27d-a1f5-4982-8ad6-9d4c9bd70a63 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filtering removed all hosts for the request with instance ID 'c1652426-1d30-4f07-919a-bef9875c9e85'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 807.225022] nova-scheduler[51961]: INFO nova.filters [None req-f5a6a27d-a1f5-4982-8ad6-9d4c9bd70a63 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filtering removed all hosts for the request with instance ID 'c1652426-1d30-4f07-919a-bef9875c9e85'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 807.225172] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-f5a6a27d-a1f5-4982-8ad6-9d4c9bd70a63 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 807.225814] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-f5a6a27d-a1f5-4982-8ad6-9d4c9bd70a63 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 811.746398] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-82adf047-d406-4aa9-85a4-2eb91c7dd22b tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Starting to schedule for instances: ['2eed2e90-c676-4dc6-98c7-2c989b0d41c9'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 811.746763] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-82adf047-d406-4aa9-85a4-2eb91c7dd22b tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 811.746950] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-82adf047-d406-4aa9-85a4-2eb91c7dd22b tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 811.751334] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-82adf047-d406-4aa9-85a4-2eb91c7dd22b tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 811.751334] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-82adf047-d406-4aa9-85a4-2eb91c7dd22b tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 811.751334] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-82adf047-d406-4aa9-85a4-2eb91c7dd22b tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 811.803835] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-82adf047-d406-4aa9-85a4-2eb91c7dd22b tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 811.803835] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-82adf047-d406-4aa9-85a4-2eb91c7dd22b tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 811.803835] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-82adf047-d406-4aa9-85a4-2eb91c7dd22b tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 811.811386] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-82adf047-d406-4aa9-85a4-2eb91c7dd22b tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 811.811386] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-82adf047-d406-4aa9-85a4-2eb91c7dd22b tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 811.811386] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-82adf047-d406-4aa9-85a4-2eb91c7dd22b tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 811.813776] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-82adf047-d406-4aa9-85a4-2eb91c7dd22b tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 811.814372] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-82adf047-d406-4aa9-85a4-2eb91c7dd22b tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 811.814846] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-82adf047-d406-4aa9-85a4-2eb91c7dd22b tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194926,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1664,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=9,service_id=None,stats={failed_builds='5',io_workload='9',num_instances='9',num_os_type_None='9',num_proj_1d9184500ed74ad7bee0d5616a6dc843='0',num_proj_6caa6881daf74a08b946fafd73ae022e='1',num_proj_750bcd4b13bb4da9937e127e5abc1201='1',num_proj_75310bd38faf4daea1ed2e141769a330='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_e13da93f325a4e68ad89ac46dfcb196b='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_deleting='5',num_task_spawning='4',num_vm_building='9'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:07:01Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=9) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 811.815220] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-82adf047-d406-4aa9-85a4-2eb91c7dd22b tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 811.815439] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-82adf047-d406-4aa9-85a4-2eb91c7dd22b tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 811.815635] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-82adf047-d406-4aa9-85a4-2eb91c7dd22b tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Update host state with instances: ['ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 811.815835] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-82adf047-d406-4aa9-85a4-2eb91c7dd22b tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 811.816427] nova-scheduler[51959]: DEBUG nova.filters [None req-82adf047-d406-4aa9-85a4-2eb91c7dd22b tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 811.816742] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-82adf047-d406-4aa9-85a4-2eb91c7dd22b tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:05:25. Elapsed time is 97.678917 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 811.816977] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-82adf047-d406-4aa9-85a4-2eb91c7dd22b tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 has not been heard from in a while [ 811.817193] nova-scheduler[51959]: INFO nova.filters [None req-82adf047-d406-4aa9-85a4-2eb91c7dd22b tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Filter ComputeFilter returned 0 hosts [ 811.817381] nova-scheduler[51959]: DEBUG nova.filters [None req-82adf047-d406-4aa9-85a4-2eb91c7dd22b tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Filtering removed all hosts for the request with instance ID '2eed2e90-c676-4dc6-98c7-2c989b0d41c9'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 811.817824] nova-scheduler[51959]: INFO nova.filters [None req-82adf047-d406-4aa9-85a4-2eb91c7dd22b tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Filtering removed all hosts for the request with instance ID '2eed2e90-c676-4dc6-98c7-2c989b0d41c9'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 811.818046] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-82adf047-d406-4aa9-85a4-2eb91c7dd22b tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 811.818245] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-82adf047-d406-4aa9-85a4-2eb91c7dd22b tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 812.300475] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-973ea549-8a3c-46c9-ae4d-872c6ac2ad39 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 812.300790] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-973ea549-8a3c-46c9-ae4d-872c6ac2ad39 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 812.300977] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-973ea549-8a3c-46c9-ae4d-872c6ac2ad39 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 812.301731] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-973ea549-8a3c-46c9-ae4d-872c6ac2ad39 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 812.302072] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-973ea549-8a3c-46c9-ae4d-872c6ac2ad39 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.002s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 812.302303] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-973ea549-8a3c-46c9-ae4d-872c6ac2ad39 tempest-ServersAdminNegativeTestJSON-1483049067 tempest-ServersAdminNegativeTestJSON-1483049067-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 813.844682] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-54f18c0f-dbfb-49e2-a515-fe828c2544ff tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Starting to schedule for instances: ['9b97f9da-31a8-40cd-9da3-3b5e548b9ef0'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 813.844971] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-54f18c0f-dbfb-49e2-a515-fe828c2544ff tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 813.845384] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-54f18c0f-dbfb-49e2-a515-fe828c2544ff tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 813.845848] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-54f18c0f-dbfb-49e2-a515-fe828c2544ff tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 813.846226] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-54f18c0f-dbfb-49e2-a515-fe828c2544ff tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 813.846612] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-54f18c0f-dbfb-49e2-a515-fe828c2544ff tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 814.000253] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-54f18c0f-dbfb-49e2-a515-fe828c2544ff tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 814.000544] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-54f18c0f-dbfb-49e2-a515-fe828c2544ff tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 814.000721] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-54f18c0f-dbfb-49e2-a515-fe828c2544ff tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 814.007272] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-54f18c0f-dbfb-49e2-a515-fe828c2544ff tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 814.007487] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-54f18c0f-dbfb-49e2-a515-fe828c2544ff tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 814.007877] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-54f18c0f-dbfb-49e2-a515-fe828c2544ff tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='16',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='0',num_proj_50469143b9b441119f5bfcff560f3a9c='1',num_proj_6caa6881daf74a08b946fafd73ae022e='1',num_proj_750bcd4b13bb4da9937e127e5abc1201='1',num_proj_75310bd38faf4daea1ed2e141769a330='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_e13da93f325a4e68ad89ac46dfcb196b='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='1',num_task_deleting='5',num_task_spawning='4',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:07:03Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 814.008183] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-54f18c0f-dbfb-49e2-a515-fe828c2544ff tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 814.008352] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-54f18c0f-dbfb-49e2-a515-fe828c2544ff tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 814.008514] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-54f18c0f-dbfb-49e2-a515-fe828c2544ff tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state with instances: ['4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67', '6874067b-8e9b-4242-9a5f-6312f1484a00', 'f03f507b-364f-41b9-ad33-dcb56ab03317'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 814.008677] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-54f18c0f-dbfb-49e2-a515-fe828c2544ff tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 814.008935] nova-scheduler[51961]: DEBUG nova.filters [None req-54f18c0f-dbfb-49e2-a515-fe828c2544ff tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 814.009162] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-54f18c0f-dbfb-49e2-a515-fe828c2544ff tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:05:25. Elapsed time is 99.871393 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 814.009321] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-54f18c0f-dbfb-49e2-a515-fe828c2544ff tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 814.009473] nova-scheduler[51961]: INFO nova.filters [None req-54f18c0f-dbfb-49e2-a515-fe828c2544ff tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filter ComputeFilter returned 0 hosts [ 814.009620] nova-scheduler[51961]: DEBUG nova.filters [None req-54f18c0f-dbfb-49e2-a515-fe828c2544ff tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filtering removed all hosts for the request with instance ID '9b97f9da-31a8-40cd-9da3-3b5e548b9ef0'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 814.009759] nova-scheduler[51961]: INFO nova.filters [None req-54f18c0f-dbfb-49e2-a515-fe828c2544ff tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filtering removed all hosts for the request with instance ID '9b97f9da-31a8-40cd-9da3-3b5e548b9ef0'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 814.009906] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-54f18c0f-dbfb-49e2-a515-fe828c2544ff tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 814.010209] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-54f18c0f-dbfb-49e2-a515-fe828c2544ff tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 816.475888] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-b42fa7dd-2fa3-4290-b805-bf086aa82854 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Starting to schedule for instances: ['df8689d6-34fa-437f-9eaf-c37a7672c25a'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 816.476376] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-b42fa7dd-2fa3-4290-b805-bf086aa82854 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 816.476556] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-b42fa7dd-2fa3-4290-b805-bf086aa82854 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 816.476993] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-b42fa7dd-2fa3-4290-b805-bf086aa82854 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 816.477397] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-b42fa7dd-2fa3-4290-b805-bf086aa82854 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 816.477629] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-b42fa7dd-2fa3-4290-b805-bf086aa82854 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 816.519418] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b42fa7dd-2fa3-4290-b805-bf086aa82854 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 816.519551] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b42fa7dd-2fa3-4290-b805-bf086aa82854 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 816.519709] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b42fa7dd-2fa3-4290-b805-bf086aa82854 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 816.526890] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b42fa7dd-2fa3-4290-b805-bf086aa82854 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 816.527122] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b42fa7dd-2fa3-4290-b805-bf086aa82854 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 816.527485] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-b42fa7dd-2fa3-4290-b805-bf086aa82854 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='16',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='0',num_proj_50469143b9b441119f5bfcff560f3a9c='1',num_proj_6caa6881daf74a08b946fafd73ae022e='1',num_proj_750bcd4b13bb4da9937e127e5abc1201='1',num_proj_75310bd38faf4daea1ed2e141769a330='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_e13da93f325a4e68ad89ac46dfcb196b='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='1',num_task_deleting='5',num_task_spawning='4',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:07:03Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 816.527758] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-b42fa7dd-2fa3-4290-b805-bf086aa82854 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 816.527930] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-b42fa7dd-2fa3-4290-b805-bf086aa82854 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 816.528113] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-b42fa7dd-2fa3-4290-b805-bf086aa82854 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Update host state with instances: ['4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67', '6874067b-8e9b-4242-9a5f-6312f1484a00', 'f03f507b-364f-41b9-ad33-dcb56ab03317'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 816.528278] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b42fa7dd-2fa3-4290-b805-bf086aa82854 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 816.528755] nova-scheduler[51959]: DEBUG nova.filters [None req-b42fa7dd-2fa3-4290-b805-bf086aa82854 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 816.529477] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-b42fa7dd-2fa3-4290-b805-bf086aa82854 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:05:25. Elapsed time is 102.391216 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 816.529477] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-b42fa7dd-2fa3-4290-b805-bf086aa82854 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 816.529477] nova-scheduler[51959]: INFO nova.filters [None req-b42fa7dd-2fa3-4290-b805-bf086aa82854 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Filter ComputeFilter returned 0 hosts [ 816.529617] nova-scheduler[51959]: DEBUG nova.filters [None req-b42fa7dd-2fa3-4290-b805-bf086aa82854 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Filtering removed all hosts for the request with instance ID 'df8689d6-34fa-437f-9eaf-c37a7672c25a'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 816.529711] nova-scheduler[51959]: INFO nova.filters [None req-b42fa7dd-2fa3-4290-b805-bf086aa82854 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Filtering removed all hosts for the request with instance ID 'df8689d6-34fa-437f-9eaf-c37a7672c25a'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 816.529853] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-b42fa7dd-2fa3-4290-b805-bf086aa82854 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 816.530063] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-b42fa7dd-2fa3-4290-b805-bf086aa82854 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 816.704501] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-88930b03-16c2-4908-8909-ded8a3cbed0d tempest-ServerTagsTestJSON-1180953540 tempest-ServerTagsTestJSON-1180953540-project-member] Starting to schedule for instances: ['53d01198-b00e-408d-b08e-2abc77091da0'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 816.704798] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-88930b03-16c2-4908-8909-ded8a3cbed0d tempest-ServerTagsTestJSON-1180953540 tempest-ServerTagsTestJSON-1180953540-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 816.704957] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-88930b03-16c2-4908-8909-ded8a3cbed0d tempest-ServerTagsTestJSON-1180953540 tempest-ServerTagsTestJSON-1180953540-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 816.707065] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-88930b03-16c2-4908-8909-ded8a3cbed0d tempest-ServerTagsTestJSON-1180953540 tempest-ServerTagsTestJSON-1180953540-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 816.707364] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-88930b03-16c2-4908-8909-ded8a3cbed0d tempest-ServerTagsTestJSON-1180953540 tempest-ServerTagsTestJSON-1180953540-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 816.707599] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-88930b03-16c2-4908-8909-ded8a3cbed0d tempest-ServerTagsTestJSON-1180953540 tempest-ServerTagsTestJSON-1180953540-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 816.763467] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-88930b03-16c2-4908-8909-ded8a3cbed0d tempest-ServerTagsTestJSON-1180953540 tempest-ServerTagsTestJSON-1180953540-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 816.763889] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-88930b03-16c2-4908-8909-ded8a3cbed0d tempest-ServerTagsTestJSON-1180953540 tempest-ServerTagsTestJSON-1180953540-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 816.764126] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-88930b03-16c2-4908-8909-ded8a3cbed0d tempest-ServerTagsTestJSON-1180953540 tempest-ServerTagsTestJSON-1180953540-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 816.773818] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-88930b03-16c2-4908-8909-ded8a3cbed0d tempest-ServerTagsTestJSON-1180953540 tempest-ServerTagsTestJSON-1180953540-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 816.774226] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-88930b03-16c2-4908-8909-ded8a3cbed0d tempest-ServerTagsTestJSON-1180953540 tempest-ServerTagsTestJSON-1180953540-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 816.776797] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-88930b03-16c2-4908-8909-ded8a3cbed0d tempest-ServerTagsTestJSON-1180953540 tempest-ServerTagsTestJSON-1180953540-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='16',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='0',num_proj_50469143b9b441119f5bfcff560f3a9c='1',num_proj_6caa6881daf74a08b946fafd73ae022e='1',num_proj_750bcd4b13bb4da9937e127e5abc1201='1',num_proj_75310bd38faf4daea1ed2e141769a330='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_e13da93f325a4e68ad89ac46dfcb196b='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='1',num_task_deleting='5',num_task_spawning='4',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:07:03Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 816.776797] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-88930b03-16c2-4908-8909-ded8a3cbed0d tempest-ServerTagsTestJSON-1180953540 tempest-ServerTagsTestJSON-1180953540-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 816.776797] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-88930b03-16c2-4908-8909-ded8a3cbed0d tempest-ServerTagsTestJSON-1180953540 tempest-ServerTagsTestJSON-1180953540-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 816.776797] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-88930b03-16c2-4908-8909-ded8a3cbed0d tempest-ServerTagsTestJSON-1180953540 tempest-ServerTagsTestJSON-1180953540-project-member] Update host state with instances: ['4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67', '6874067b-8e9b-4242-9a5f-6312f1484a00', 'f03f507b-364f-41b9-ad33-dcb56ab03317'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 816.776797] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-88930b03-16c2-4908-8909-ded8a3cbed0d tempest-ServerTagsTestJSON-1180953540 tempest-ServerTagsTestJSON-1180953540-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 816.776797] nova-scheduler[51961]: DEBUG nova.filters [None req-88930b03-16c2-4908-8909-ded8a3cbed0d tempest-ServerTagsTestJSON-1180953540 tempest-ServerTagsTestJSON-1180953540-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 816.776797] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-88930b03-16c2-4908-8909-ded8a3cbed0d tempest-ServerTagsTestJSON-1180953540 tempest-ServerTagsTestJSON-1180953540-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:05:25. Elapsed time is 102.638509 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 816.777237] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-88930b03-16c2-4908-8909-ded8a3cbed0d tempest-ServerTagsTestJSON-1180953540 tempest-ServerTagsTestJSON-1180953540-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 816.777237] nova-scheduler[51961]: INFO nova.filters [None req-88930b03-16c2-4908-8909-ded8a3cbed0d tempest-ServerTagsTestJSON-1180953540 tempest-ServerTagsTestJSON-1180953540-project-member] Filter ComputeFilter returned 0 hosts [ 816.777237] nova-scheduler[51961]: DEBUG nova.filters [None req-88930b03-16c2-4908-8909-ded8a3cbed0d tempest-ServerTagsTestJSON-1180953540 tempest-ServerTagsTestJSON-1180953540-project-member] Filtering removed all hosts for the request with instance ID '53d01198-b00e-408d-b08e-2abc77091da0'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 816.777237] nova-scheduler[51961]: INFO nova.filters [None req-88930b03-16c2-4908-8909-ded8a3cbed0d tempest-ServerTagsTestJSON-1180953540 tempest-ServerTagsTestJSON-1180953540-project-member] Filtering removed all hosts for the request with instance ID '53d01198-b00e-408d-b08e-2abc77091da0'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 816.778012] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-88930b03-16c2-4908-8909-ded8a3cbed0d tempest-ServerTagsTestJSON-1180953540 tempest-ServerTagsTestJSON-1180953540-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 816.778012] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-88930b03-16c2-4908-8909-ded8a3cbed0d tempest-ServerTagsTestJSON-1180953540 tempest-ServerTagsTestJSON-1180953540-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 818.112707] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-462f7ad4-5898-4cf3-af4a-303d1593ae79 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Starting to schedule for instances: ['3f70699b-2ea9-4700-bad6-8a48abfcab5b'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 818.112948] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-462f7ad4-5898-4cf3-af4a-303d1593ae79 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 818.113116] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-462f7ad4-5898-4cf3-af4a-303d1593ae79 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 818.113298] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-462f7ad4-5898-4cf3-af4a-303d1593ae79 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 818.113492] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-462f7ad4-5898-4cf3-af4a-303d1593ae79 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 818.113847] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-462f7ad4-5898-4cf3-af4a-303d1593ae79 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 818.156767] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-462f7ad4-5898-4cf3-af4a-303d1593ae79 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 818.157012] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-462f7ad4-5898-4cf3-af4a-303d1593ae79 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 818.157177] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-462f7ad4-5898-4cf3-af4a-303d1593ae79 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 818.164211] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-462f7ad4-5898-4cf3-af4a-303d1593ae79 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 818.164346] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-462f7ad4-5898-4cf3-af4a-303d1593ae79 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 818.164693] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-462f7ad4-5898-4cf3-af4a-303d1593ae79 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='16',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='0',num_proj_50469143b9b441119f5bfcff560f3a9c='1',num_proj_6caa6881daf74a08b946fafd73ae022e='1',num_proj_750bcd4b13bb4da9937e127e5abc1201='1',num_proj_75310bd38faf4daea1ed2e141769a330='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_e13da93f325a4e68ad89ac46dfcb196b='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='1',num_task_deleting='5',num_task_spawning='4',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:07:03Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 818.165016] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-462f7ad4-5898-4cf3-af4a-303d1593ae79 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 818.165202] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-462f7ad4-5898-4cf3-af4a-303d1593ae79 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 818.165418] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-462f7ad4-5898-4cf3-af4a-303d1593ae79 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state with instances: ['4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67', '6874067b-8e9b-4242-9a5f-6312f1484a00', 'f03f507b-364f-41b9-ad33-dcb56ab03317'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 818.165528] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-462f7ad4-5898-4cf3-af4a-303d1593ae79 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 818.165780] nova-scheduler[51959]: DEBUG nova.filters [None req-462f7ad4-5898-4cf3-af4a-303d1593ae79 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 818.166008] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-462f7ad4-5898-4cf3-af4a-303d1593ae79 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:05:25. Elapsed time is 104.028238 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 818.166186] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-462f7ad4-5898-4cf3-af4a-303d1593ae79 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 818.166339] nova-scheduler[51959]: INFO nova.filters [None req-462f7ad4-5898-4cf3-af4a-303d1593ae79 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filter ComputeFilter returned 0 hosts [ 818.166490] nova-scheduler[51959]: DEBUG nova.filters [None req-462f7ad4-5898-4cf3-af4a-303d1593ae79 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filtering removed all hosts for the request with instance ID '3f70699b-2ea9-4700-bad6-8a48abfcab5b'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 818.166629] nova-scheduler[51959]: INFO nova.filters [None req-462f7ad4-5898-4cf3-af4a-303d1593ae79 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filtering removed all hosts for the request with instance ID '3f70699b-2ea9-4700-bad6-8a48abfcab5b'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 818.166770] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-462f7ad4-5898-4cf3-af4a-303d1593ae79 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 818.166924] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-462f7ad4-5898-4cf3-af4a-303d1593ae79 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 819.301782] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-2b58b7d1-88b2-4659-8a8c-1b807ec8776a tempest-AttachInterfacesUnderV243Test-1729314279 tempest-AttachInterfacesUnderV243Test-1729314279-project-member] Starting to schedule for instances: ['2f4f4601-de9f-4f41-93e9-a1526b2d1659'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 819.302103] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-2b58b7d1-88b2-4659-8a8c-1b807ec8776a tempest-AttachInterfacesUnderV243Test-1729314279 tempest-AttachInterfacesUnderV243Test-1729314279-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 819.302267] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-2b58b7d1-88b2-4659-8a8c-1b807ec8776a tempest-AttachInterfacesUnderV243Test-1729314279 tempest-AttachInterfacesUnderV243Test-1729314279-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 819.302447] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-2b58b7d1-88b2-4659-8a8c-1b807ec8776a tempest-AttachInterfacesUnderV243Test-1729314279 tempest-AttachInterfacesUnderV243Test-1729314279-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 819.302644] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-2b58b7d1-88b2-4659-8a8c-1b807ec8776a tempest-AttachInterfacesUnderV243Test-1729314279 tempest-AttachInterfacesUnderV243Test-1729314279-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 819.302820] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-2b58b7d1-88b2-4659-8a8c-1b807ec8776a tempest-AttachInterfacesUnderV243Test-1729314279 tempest-AttachInterfacesUnderV243Test-1729314279-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 819.359374] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-2b58b7d1-88b2-4659-8a8c-1b807ec8776a tempest-AttachInterfacesUnderV243Test-1729314279 tempest-AttachInterfacesUnderV243Test-1729314279-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 819.359621] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-2b58b7d1-88b2-4659-8a8c-1b807ec8776a tempest-AttachInterfacesUnderV243Test-1729314279 tempest-AttachInterfacesUnderV243Test-1729314279-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 819.359845] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-2b58b7d1-88b2-4659-8a8c-1b807ec8776a tempest-AttachInterfacesUnderV243Test-1729314279 tempest-AttachInterfacesUnderV243Test-1729314279-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 819.367503] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-2b58b7d1-88b2-4659-8a8c-1b807ec8776a tempest-AttachInterfacesUnderV243Test-1729314279 tempest-AttachInterfacesUnderV243Test-1729314279-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 819.367929] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-2b58b7d1-88b2-4659-8a8c-1b807ec8776a tempest-AttachInterfacesUnderV243Test-1729314279 tempest-AttachInterfacesUnderV243Test-1729314279-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 819.368386] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-2b58b7d1-88b2-4659-8a8c-1b807ec8776a tempest-AttachInterfacesUnderV243Test-1729314279 tempest-AttachInterfacesUnderV243Test-1729314279-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='16',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='0',num_proj_50469143b9b441119f5bfcff560f3a9c='1',num_proj_6caa6881daf74a08b946fafd73ae022e='1',num_proj_750bcd4b13bb4da9937e127e5abc1201='1',num_proj_75310bd38faf4daea1ed2e141769a330='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_e13da93f325a4e68ad89ac46dfcb196b='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='1',num_task_deleting='5',num_task_spawning='4',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:07:03Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 819.368708] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-2b58b7d1-88b2-4659-8a8c-1b807ec8776a tempest-AttachInterfacesUnderV243Test-1729314279 tempest-AttachInterfacesUnderV243Test-1729314279-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 819.368913] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-2b58b7d1-88b2-4659-8a8c-1b807ec8776a tempest-AttachInterfacesUnderV243Test-1729314279 tempest-AttachInterfacesUnderV243Test-1729314279-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 819.369128] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-2b58b7d1-88b2-4659-8a8c-1b807ec8776a tempest-AttachInterfacesUnderV243Test-1729314279 tempest-AttachInterfacesUnderV243Test-1729314279-project-member] Update host state with instances: ['4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67', '6874067b-8e9b-4242-9a5f-6312f1484a00', 'f03f507b-364f-41b9-ad33-dcb56ab03317'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 819.369333] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-2b58b7d1-88b2-4659-8a8c-1b807ec8776a tempest-AttachInterfacesUnderV243Test-1729314279 tempest-AttachInterfacesUnderV243Test-1729314279-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 819.369637] nova-scheduler[51961]: DEBUG nova.filters [None req-2b58b7d1-88b2-4659-8a8c-1b807ec8776a tempest-AttachInterfacesUnderV243Test-1729314279 tempest-AttachInterfacesUnderV243Test-1729314279-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 819.369888] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-2b58b7d1-88b2-4659-8a8c-1b807ec8776a tempest-AttachInterfacesUnderV243Test-1729314279 tempest-AttachInterfacesUnderV243Test-1729314279-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:05:25. Elapsed time is 105.232118 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 819.370095] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-2b58b7d1-88b2-4659-8a8c-1b807ec8776a tempest-AttachInterfacesUnderV243Test-1729314279 tempest-AttachInterfacesUnderV243Test-1729314279-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 819.370285] nova-scheduler[51961]: INFO nova.filters [None req-2b58b7d1-88b2-4659-8a8c-1b807ec8776a tempest-AttachInterfacesUnderV243Test-1729314279 tempest-AttachInterfacesUnderV243Test-1729314279-project-member] Filter ComputeFilter returned 0 hosts [ 819.370467] nova-scheduler[51961]: DEBUG nova.filters [None req-2b58b7d1-88b2-4659-8a8c-1b807ec8776a tempest-AttachInterfacesUnderV243Test-1729314279 tempest-AttachInterfacesUnderV243Test-1729314279-project-member] Filtering removed all hosts for the request with instance ID '2f4f4601-de9f-4f41-93e9-a1526b2d1659'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 819.370637] nova-scheduler[51961]: INFO nova.filters [None req-2b58b7d1-88b2-4659-8a8c-1b807ec8776a tempest-AttachInterfacesUnderV243Test-1729314279 tempest-AttachInterfacesUnderV243Test-1729314279-project-member] Filtering removed all hosts for the request with instance ID '2f4f4601-de9f-4f41-93e9-a1526b2d1659'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 819.370830] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-2b58b7d1-88b2-4659-8a8c-1b807ec8776a tempest-AttachInterfacesUnderV243Test-1729314279 tempest-AttachInterfacesUnderV243Test-1729314279-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 819.371116] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-2b58b7d1-88b2-4659-8a8c-1b807ec8776a tempest-AttachInterfacesUnderV243Test-1729314279 tempest-AttachInterfacesUnderV243Test-1729314279-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 819.914655] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-0956fc0d-5bbf-49a0-8394-d4ff67018b11 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Starting to schedule for instances: ['1445da40-483f-4094-87c4-6c5a2214d7af'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 819.914655] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-0956fc0d-5bbf-49a0-8394-d4ff67018b11 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 819.914655] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-0956fc0d-5bbf-49a0-8394-d4ff67018b11 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 819.914655] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-0956fc0d-5bbf-49a0-8394-d4ff67018b11 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 819.914655] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-0956fc0d-5bbf-49a0-8394-d4ff67018b11 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 819.914655] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-0956fc0d-5bbf-49a0-8394-d4ff67018b11 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 819.969283] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0956fc0d-5bbf-49a0-8394-d4ff67018b11 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 819.969364] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0956fc0d-5bbf-49a0-8394-d4ff67018b11 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 819.969521] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0956fc0d-5bbf-49a0-8394-d4ff67018b11 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 819.976383] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0956fc0d-5bbf-49a0-8394-d4ff67018b11 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 819.980043] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0956fc0d-5bbf-49a0-8394-d4ff67018b11 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 819.980043] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-0956fc0d-5bbf-49a0-8394-d4ff67018b11 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='16',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='0',num_proj_50469143b9b441119f5bfcff560f3a9c='1',num_proj_6caa6881daf74a08b946fafd73ae022e='1',num_proj_750bcd4b13bb4da9937e127e5abc1201='1',num_proj_75310bd38faf4daea1ed2e141769a330='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_e13da93f325a4e68ad89ac46dfcb196b='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='1',num_task_deleting='5',num_task_spawning='4',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:07:03Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 819.980043] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-0956fc0d-5bbf-49a0-8394-d4ff67018b11 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 819.980043] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-0956fc0d-5bbf-49a0-8394-d4ff67018b11 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 819.980043] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-0956fc0d-5bbf-49a0-8394-d4ff67018b11 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Update host state with instances: ['4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67', '6874067b-8e9b-4242-9a5f-6312f1484a00', 'f03f507b-364f-41b9-ad33-dcb56ab03317'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 819.980043] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0956fc0d-5bbf-49a0-8394-d4ff67018b11 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 819.980043] nova-scheduler[51959]: DEBUG nova.filters [None req-0956fc0d-5bbf-49a0-8394-d4ff67018b11 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 819.980665] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-0956fc0d-5bbf-49a0-8394-d4ff67018b11 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:05:25. Elapsed time is 105.840535 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 819.980665] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-0956fc0d-5bbf-49a0-8394-d4ff67018b11 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 819.980665] nova-scheduler[51959]: INFO nova.filters [None req-0956fc0d-5bbf-49a0-8394-d4ff67018b11 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Filter ComputeFilter returned 0 hosts [ 819.980665] nova-scheduler[51959]: DEBUG nova.filters [None req-0956fc0d-5bbf-49a0-8394-d4ff67018b11 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Filtering removed all hosts for the request with instance ID '1445da40-483f-4094-87c4-6c5a2214d7af'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 819.980665] nova-scheduler[51959]: INFO nova.filters [None req-0956fc0d-5bbf-49a0-8394-d4ff67018b11 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Filtering removed all hosts for the request with instance ID '1445da40-483f-4094-87c4-6c5a2214d7af'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 819.980665] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-0956fc0d-5bbf-49a0-8394-d4ff67018b11 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 819.980665] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-0956fc0d-5bbf-49a0-8394-d4ff67018b11 tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 821.329853] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-64ea3b7d-3e5d-4e9f-89ef-aac8079f485d tempest-ServersNegativeTestMultiTenantJSON-1475797793 tempest-ServersNegativeTestMultiTenantJSON-1475797793-project-member] Starting to schedule for instances: ['835055fb-1b63-4895-8676-e52e617393ec'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 821.330843] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-64ea3b7d-3e5d-4e9f-89ef-aac8079f485d tempest-ServersNegativeTestMultiTenantJSON-1475797793 tempest-ServersNegativeTestMultiTenantJSON-1475797793-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 821.331068] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-64ea3b7d-3e5d-4e9f-89ef-aac8079f485d tempest-ServersNegativeTestMultiTenantJSON-1475797793 tempest-ServersNegativeTestMultiTenantJSON-1475797793-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 821.331273] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-64ea3b7d-3e5d-4e9f-89ef-aac8079f485d tempest-ServersNegativeTestMultiTenantJSON-1475797793 tempest-ServersNegativeTestMultiTenantJSON-1475797793-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 821.331474] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-64ea3b7d-3e5d-4e9f-89ef-aac8079f485d tempest-ServersNegativeTestMultiTenantJSON-1475797793 tempest-ServersNegativeTestMultiTenantJSON-1475797793-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 821.331657] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-64ea3b7d-3e5d-4e9f-89ef-aac8079f485d tempest-ServersNegativeTestMultiTenantJSON-1475797793 tempest-ServersNegativeTestMultiTenantJSON-1475797793-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 821.376579] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-64ea3b7d-3e5d-4e9f-89ef-aac8079f485d tempest-ServersNegativeTestMultiTenantJSON-1475797793 tempest-ServersNegativeTestMultiTenantJSON-1475797793-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 821.376811] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-64ea3b7d-3e5d-4e9f-89ef-aac8079f485d tempest-ServersNegativeTestMultiTenantJSON-1475797793 tempest-ServersNegativeTestMultiTenantJSON-1475797793-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 821.376991] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-64ea3b7d-3e5d-4e9f-89ef-aac8079f485d tempest-ServersNegativeTestMultiTenantJSON-1475797793 tempest-ServersNegativeTestMultiTenantJSON-1475797793-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 821.386866] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-64ea3b7d-3e5d-4e9f-89ef-aac8079f485d tempest-ServersNegativeTestMultiTenantJSON-1475797793 tempest-ServersNegativeTestMultiTenantJSON-1475797793-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 821.386866] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-64ea3b7d-3e5d-4e9f-89ef-aac8079f485d tempest-ServersNegativeTestMultiTenantJSON-1475797793 tempest-ServersNegativeTestMultiTenantJSON-1475797793-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 821.389264] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-64ea3b7d-3e5d-4e9f-89ef-aac8079f485d tempest-ServersNegativeTestMultiTenantJSON-1475797793 tempest-ServersNegativeTestMultiTenantJSON-1475797793-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='16',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='0',num_proj_50469143b9b441119f5bfcff560f3a9c='1',num_proj_6caa6881daf74a08b946fafd73ae022e='1',num_proj_750bcd4b13bb4da9937e127e5abc1201='1',num_proj_75310bd38faf4daea1ed2e141769a330='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_e13da93f325a4e68ad89ac46dfcb196b='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='1',num_task_deleting='5',num_task_spawning='4',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:07:03Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 821.389264] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-64ea3b7d-3e5d-4e9f-89ef-aac8079f485d tempest-ServersNegativeTestMultiTenantJSON-1475797793 tempest-ServersNegativeTestMultiTenantJSON-1475797793-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 821.389264] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-64ea3b7d-3e5d-4e9f-89ef-aac8079f485d tempest-ServersNegativeTestMultiTenantJSON-1475797793 tempest-ServersNegativeTestMultiTenantJSON-1475797793-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 821.389264] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-64ea3b7d-3e5d-4e9f-89ef-aac8079f485d tempest-ServersNegativeTestMultiTenantJSON-1475797793 tempest-ServersNegativeTestMultiTenantJSON-1475797793-project-member] Update host state with instances: ['4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67', '6874067b-8e9b-4242-9a5f-6312f1484a00', 'f03f507b-364f-41b9-ad33-dcb56ab03317'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 821.389264] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-64ea3b7d-3e5d-4e9f-89ef-aac8079f485d tempest-ServersNegativeTestMultiTenantJSON-1475797793 tempest-ServersNegativeTestMultiTenantJSON-1475797793-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 821.389264] nova-scheduler[51961]: DEBUG nova.filters [None req-64ea3b7d-3e5d-4e9f-89ef-aac8079f485d tempest-ServersNegativeTestMultiTenantJSON-1475797793 tempest-ServersNegativeTestMultiTenantJSON-1475797793-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 821.389264] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-64ea3b7d-3e5d-4e9f-89ef-aac8079f485d tempest-ServersNegativeTestMultiTenantJSON-1475797793 tempest-ServersNegativeTestMultiTenantJSON-1475797793-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:05:25. Elapsed time is 107.250711 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 821.389615] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-64ea3b7d-3e5d-4e9f-89ef-aac8079f485d tempest-ServersNegativeTestMultiTenantJSON-1475797793 tempest-ServersNegativeTestMultiTenantJSON-1475797793-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 821.389615] nova-scheduler[51961]: INFO nova.filters [None req-64ea3b7d-3e5d-4e9f-89ef-aac8079f485d tempest-ServersNegativeTestMultiTenantJSON-1475797793 tempest-ServersNegativeTestMultiTenantJSON-1475797793-project-member] Filter ComputeFilter returned 0 hosts [ 821.389615] nova-scheduler[51961]: DEBUG nova.filters [None req-64ea3b7d-3e5d-4e9f-89ef-aac8079f485d tempest-ServersNegativeTestMultiTenantJSON-1475797793 tempest-ServersNegativeTestMultiTenantJSON-1475797793-project-member] Filtering removed all hosts for the request with instance ID '835055fb-1b63-4895-8676-e52e617393ec'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 821.389615] nova-scheduler[51961]: INFO nova.filters [None req-64ea3b7d-3e5d-4e9f-89ef-aac8079f485d tempest-ServersNegativeTestMultiTenantJSON-1475797793 tempest-ServersNegativeTestMultiTenantJSON-1475797793-project-member] Filtering removed all hosts for the request with instance ID '835055fb-1b63-4895-8676-e52e617393ec'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 821.389615] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-64ea3b7d-3e5d-4e9f-89ef-aac8079f485d tempest-ServersNegativeTestMultiTenantJSON-1475797793 tempest-ServersNegativeTestMultiTenantJSON-1475797793-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 821.389615] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-64ea3b7d-3e5d-4e9f-89ef-aac8079f485d tempest-ServersNegativeTestMultiTenantJSON-1475797793 tempest-ServersNegativeTestMultiTenantJSON-1475797793-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 822.345530] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-7a2b4e44-d964-43dd-9d9b-2dcdbe58fba9 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Starting to schedule for instances: ['29d7d52b-c973-416c-8e57-b85a71542a47'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 822.346508] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-7a2b4e44-d964-43dd-9d9b-2dcdbe58fba9 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 822.346827] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-7a2b4e44-d964-43dd-9d9b-2dcdbe58fba9 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 822.347412] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-7a2b4e44-d964-43dd-9d9b-2dcdbe58fba9 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 822.347768] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-7a2b4e44-d964-43dd-9d9b-2dcdbe58fba9 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 822.348322] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-7a2b4e44-d964-43dd-9d9b-2dcdbe58fba9 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 822.404762] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-7a2b4e44-d964-43dd-9d9b-2dcdbe58fba9 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 822.404762] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-7a2b4e44-d964-43dd-9d9b-2dcdbe58fba9 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 822.404762] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-7a2b4e44-d964-43dd-9d9b-2dcdbe58fba9 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 822.415018] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-7a2b4e44-d964-43dd-9d9b-2dcdbe58fba9 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 822.415018] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-7a2b4e44-d964-43dd-9d9b-2dcdbe58fba9 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 822.415018] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-7a2b4e44-d964-43dd-9d9b-2dcdbe58fba9 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='16',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='0',num_proj_50469143b9b441119f5bfcff560f3a9c='1',num_proj_6caa6881daf74a08b946fafd73ae022e='1',num_proj_750bcd4b13bb4da9937e127e5abc1201='1',num_proj_75310bd38faf4daea1ed2e141769a330='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_e13da93f325a4e68ad89ac46dfcb196b='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='1',num_task_deleting='5',num_task_spawning='4',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:07:03Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 822.415018] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-7a2b4e44-d964-43dd-9d9b-2dcdbe58fba9 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 822.415018] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-7a2b4e44-d964-43dd-9d9b-2dcdbe58fba9 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 822.415018] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-7a2b4e44-d964-43dd-9d9b-2dcdbe58fba9 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state with instances: ['4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67', '6874067b-8e9b-4242-9a5f-6312f1484a00', 'f03f507b-364f-41b9-ad33-dcb56ab03317'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 822.415018] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-7a2b4e44-d964-43dd-9d9b-2dcdbe58fba9 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 822.415401] nova-scheduler[51959]: DEBUG nova.filters [None req-7a2b4e44-d964-43dd-9d9b-2dcdbe58fba9 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 822.415401] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-7a2b4e44-d964-43dd-9d9b-2dcdbe58fba9 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:05:25. Elapsed time is 108.276966 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 822.415401] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-7a2b4e44-d964-43dd-9d9b-2dcdbe58fba9 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 822.415735] nova-scheduler[51959]: INFO nova.filters [None req-7a2b4e44-d964-43dd-9d9b-2dcdbe58fba9 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filter ComputeFilter returned 0 hosts [ 822.416056] nova-scheduler[51959]: DEBUG nova.filters [None req-7a2b4e44-d964-43dd-9d9b-2dcdbe58fba9 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filtering removed all hosts for the request with instance ID '29d7d52b-c973-416c-8e57-b85a71542a47'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 822.417830] nova-scheduler[51959]: INFO nova.filters [None req-7a2b4e44-d964-43dd-9d9b-2dcdbe58fba9 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filtering removed all hosts for the request with instance ID '29d7d52b-c973-416c-8e57-b85a71542a47'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 822.417830] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-7a2b4e44-d964-43dd-9d9b-2dcdbe58fba9 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 822.417830] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-7a2b4e44-d964-43dd-9d9b-2dcdbe58fba9 tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 823.499698] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-c8f7c8da-b50e-476e-beea-219712b4f37e tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Starting to schedule for instances: ['ffdff847-fef6-453f-b652-57c397067b5e'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 823.500056] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c8f7c8da-b50e-476e-beea-219712b4f37e tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 823.500225] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c8f7c8da-b50e-476e-beea-219712b4f37e tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 823.500459] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c8f7c8da-b50e-476e-beea-219712b4f37e tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 823.500692] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c8f7c8da-b50e-476e-beea-219712b4f37e tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 823.501376] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c8f7c8da-b50e-476e-beea-219712b4f37e tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 823.550248] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c8f7c8da-b50e-476e-beea-219712b4f37e tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 823.550367] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c8f7c8da-b50e-476e-beea-219712b4f37e tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 823.550445] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c8f7c8da-b50e-476e-beea-219712b4f37e tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 823.557784] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c8f7c8da-b50e-476e-beea-219712b4f37e tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 823.558013] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c8f7c8da-b50e-476e-beea-219712b4f37e tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 823.558379] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-c8f7c8da-b50e-476e-beea-219712b4f37e tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='16',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='0',num_proj_50469143b9b441119f5bfcff560f3a9c='1',num_proj_6caa6881daf74a08b946fafd73ae022e='1',num_proj_750bcd4b13bb4da9937e127e5abc1201='1',num_proj_75310bd38faf4daea1ed2e141769a330='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_e13da93f325a4e68ad89ac46dfcb196b='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='1',num_task_deleting='5',num_task_spawning='4',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:07:03Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 823.558654] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-c8f7c8da-b50e-476e-beea-219712b4f37e tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 823.558825] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-c8f7c8da-b50e-476e-beea-219712b4f37e tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 823.558988] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-c8f7c8da-b50e-476e-beea-219712b4f37e tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Update host state with instances: ['4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67', '6874067b-8e9b-4242-9a5f-6312f1484a00', 'f03f507b-364f-41b9-ad33-dcb56ab03317'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 823.559169] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c8f7c8da-b50e-476e-beea-219712b4f37e tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 823.559421] nova-scheduler[51961]: DEBUG nova.filters [None req-c8f7c8da-b50e-476e-beea-219712b4f37e tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 823.559631] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-c8f7c8da-b50e-476e-beea-219712b4f37e tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:05:25. Elapsed time is 109.421873 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 823.559787] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-c8f7c8da-b50e-476e-beea-219712b4f37e tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 823.559939] nova-scheduler[51961]: INFO nova.filters [None req-c8f7c8da-b50e-476e-beea-219712b4f37e tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Filter ComputeFilter returned 0 hosts [ 823.560180] nova-scheduler[51961]: DEBUG nova.filters [None req-c8f7c8da-b50e-476e-beea-219712b4f37e tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Filtering removed all hosts for the request with instance ID 'ffdff847-fef6-453f-b652-57c397067b5e'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 823.560251] nova-scheduler[51961]: INFO nova.filters [None req-c8f7c8da-b50e-476e-beea-219712b4f37e tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Filtering removed all hosts for the request with instance ID 'ffdff847-fef6-453f-b652-57c397067b5e'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 823.560383] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-c8f7c8da-b50e-476e-beea-219712b4f37e tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 823.560528] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-c8f7c8da-b50e-476e-beea-219712b4f37e tempest-ServerDiskConfigTestJSON-667820123 tempest-ServerDiskConfigTestJSON-667820123-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 825.024136] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-446dfe63-27ac-4e77-96ec-ad472ce7b54e tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Starting to schedule for instances: ['326e6624-2db7-4a63-b075-d24c4dd74730'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 825.025027] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-446dfe63-27ac-4e77-96ec-ad472ce7b54e tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 825.025027] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-446dfe63-27ac-4e77-96ec-ad472ce7b54e tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 825.025027] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-446dfe63-27ac-4e77-96ec-ad472ce7b54e tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 825.025027] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-446dfe63-27ac-4e77-96ec-ad472ce7b54e tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 825.030249] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-446dfe63-27ac-4e77-96ec-ad472ce7b54e tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 825.079292] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-446dfe63-27ac-4e77-96ec-ad472ce7b54e tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 825.079376] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-446dfe63-27ac-4e77-96ec-ad472ce7b54e tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 825.079546] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-446dfe63-27ac-4e77-96ec-ad472ce7b54e tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 825.089205] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-446dfe63-27ac-4e77-96ec-ad472ce7b54e tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 825.089436] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-446dfe63-27ac-4e77-96ec-ad472ce7b54e tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 825.089848] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-446dfe63-27ac-4e77-96ec-ad472ce7b54e tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='16',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_1d9184500ed74ad7bee0d5616a6dc843='0',num_proj_50469143b9b441119f5bfcff560f3a9c='1',num_proj_6caa6881daf74a08b946fafd73ae022e='1',num_proj_750bcd4b13bb4da9937e127e5abc1201='1',num_proj_75310bd38faf4daea1ed2e141769a330='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_e13da93f325a4e68ad89ac46dfcb196b='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_None='1',num_task_deleting='5',num_task_spawning='4',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:07:03Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=10) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 825.090105] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-446dfe63-27ac-4e77-96ec-ad472ce7b54e tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 825.090270] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-446dfe63-27ac-4e77-96ec-ad472ce7b54e tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 825.090484] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-446dfe63-27ac-4e77-96ec-ad472ce7b54e tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Update host state with instances: ['4e62d785-7c74-4d3a-9446-e690822d5386', 'ebc60b43-dc9e-4f3c-81c7-f65fe50be628', 'ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67', '6874067b-8e9b-4242-9a5f-6312f1484a00', 'f03f507b-364f-41b9-ad33-dcb56ab03317'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 825.090686] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-446dfe63-27ac-4e77-96ec-ad472ce7b54e tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 825.090957] nova-scheduler[51959]: DEBUG nova.filters [None req-446dfe63-27ac-4e77-96ec-ad472ce7b54e tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 825.091198] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-446dfe63-27ac-4e77-96ec-ad472ce7b54e tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:05:25. Elapsed time is 110.953412 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 825.091358] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-446dfe63-27ac-4e77-96ec-ad472ce7b54e tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 825.095018] nova-scheduler[51959]: INFO nova.filters [None req-446dfe63-27ac-4e77-96ec-ad472ce7b54e tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filter ComputeFilter returned 0 hosts [ 825.095018] nova-scheduler[51959]: DEBUG nova.filters [None req-446dfe63-27ac-4e77-96ec-ad472ce7b54e tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filtering removed all hosts for the request with instance ID '326e6624-2db7-4a63-b075-d24c4dd74730'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 825.095018] nova-scheduler[51959]: INFO nova.filters [None req-446dfe63-27ac-4e77-96ec-ad472ce7b54e tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filtering removed all hosts for the request with instance ID '326e6624-2db7-4a63-b075-d24c4dd74730'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 825.095018] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-446dfe63-27ac-4e77-96ec-ad472ce7b54e tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 825.095018] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-446dfe63-27ac-4e77-96ec-ad472ce7b54e tempest-ServersTestJSON-1853208137 tempest-ServersTestJSON-1853208137-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 830.037966] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-74bfc624-20f7-414a-b03e-6a6defcd3c89 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 830.038300] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-74bfc624-20f7-414a-b03e-6a6defcd3c89 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 830.039318] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-74bfc624-20f7-414a-b03e-6a6defcd3c89 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 830.039318] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-74bfc624-20f7-414a-b03e-6a6defcd3c89 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 830.040024] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-74bfc624-20f7-414a-b03e-6a6defcd3c89 None None] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 830.040705] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-74bfc624-20f7-414a-b03e-6a6defcd3c89 None None] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 830.040705] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-74bfc624-20f7-414a-b03e-6a6defcd3c89 None None] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 830.041561] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-74bfc624-20f7-414a-b03e-6a6defcd3c89 None None] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 830.041929] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-74bfc624-20f7-414a-b03e-6a6defcd3c89 None None] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 830.042170] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-74bfc624-20f7-414a-b03e-6a6defcd3c89 None None] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 830.046041] nova-scheduler[51961]: INFO nova.scheduler.host_manager [None req-74bfc624-20f7-414a-b03e-6a6defcd3c89 None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 830.046041] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-74bfc624-20f7-414a-b03e-6a6defcd3c89 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.007s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 830.047656] nova-scheduler[51959]: INFO nova.scheduler.host_manager [None req-74bfc624-20f7-414a-b03e-6a6defcd3c89 None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 830.047991] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-74bfc624-20f7-414a-b03e-6a6defcd3c89 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.009s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 833.277998] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-1c697637-880a-40a9-9f00-0593fd04f088 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Starting to schedule for instances: ['f0fc3472-42e8-42a3-b287-e0de87299c5b'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 833.278349] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-1c697637-880a-40a9-9f00-0593fd04f088 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 833.278961] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-1c697637-880a-40a9-9f00-0593fd04f088 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 833.278961] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-1c697637-880a-40a9-9f00-0593fd04f088 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 833.278961] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-1c697637-880a-40a9-9f00-0593fd04f088 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 833.279204] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-1c697637-880a-40a9-9f00-0593fd04f088 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 833.324614] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-1c697637-880a-40a9-9f00-0593fd04f088 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 833.324869] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-1c697637-880a-40a9-9f00-0593fd04f088 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 833.325064] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-1c697637-880a-40a9-9f00-0593fd04f088 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 833.331519] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-1c697637-880a-40a9-9f00-0593fd04f088 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 833.331718] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-1c697637-880a-40a9-9f00-0593fd04f088 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 833.331909] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-1c697637-880a-40a9-9f00-0593fd04f088 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 833.334025] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-1c697637-880a-40a9-9f00-0593fd04f088 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 833.334228] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-1c697637-880a-40a9-9f00-0593fd04f088 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 833.334591] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-1c697637-880a-40a9-9f00-0593fd04f088 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=5,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='16',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_deleting='5',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:07:22Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=5) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 833.334867] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-1c697637-880a-40a9-9f00-0593fd04f088 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 833.335053] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-1c697637-880a-40a9-9f00-0593fd04f088 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 5, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 833.335214] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-1c697637-880a-40a9-9f00-0593fd04f088 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Update host state with instances: ['ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 833.335377] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-1c697637-880a-40a9-9f00-0593fd04f088 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 833.335617] nova-scheduler[51961]: DEBUG nova.filters [None req-1c697637-880a-40a9-9f00-0593fd04f088 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 833.335824] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-1c697637-880a-40a9-9f00-0593fd04f088 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:05:25. Elapsed time is 119.198067 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 833.335979] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-1c697637-880a-40a9-9f00-0593fd04f088 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 833.336148] nova-scheduler[51961]: INFO nova.filters [None req-1c697637-880a-40a9-9f00-0593fd04f088 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Filter ComputeFilter returned 0 hosts [ 833.336300] nova-scheduler[51961]: DEBUG nova.filters [None req-1c697637-880a-40a9-9f00-0593fd04f088 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Filtering removed all hosts for the request with instance ID 'f0fc3472-42e8-42a3-b287-e0de87299c5b'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 833.336440] nova-scheduler[51961]: INFO nova.filters [None req-1c697637-880a-40a9-9f00-0593fd04f088 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Filtering removed all hosts for the request with instance ID 'f0fc3472-42e8-42a3-b287-e0de87299c5b'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 833.336584] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-1c697637-880a-40a9-9f00-0593fd04f088 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 833.336730] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-1c697637-880a-40a9-9f00-0593fd04f088 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 835.876565] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Starting to schedule for instances: ['f3566a4b-8fe0-4c85-9c45-7c67cfd30323'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 835.876860] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 835.877031] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 835.877213] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 835.877416] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 835.877592] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 835.916371] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 835.916591] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 835.916758] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 835.924441] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 835.924685] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 835.924894] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 835.928118] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 835.928364] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 835.928741] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=5,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='16',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_deleting='5',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:07:22Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=5) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 835.929044] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 835.929222] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 7, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 7, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 835.929382] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Update host state with instances: ['ce718fc3-6f75-49b9-8543-c953646ce0d9', '426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 835.929548] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 835.929800] nova-scheduler[51959]: DEBUG nova.filters [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 835.930018] nova-scheduler[51959]: DEBUG nova.filters [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 835.930206] nova-scheduler[51959]: DEBUG nova.filters [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 835.930404] nova-scheduler[51959]: DEBUG nova.filters [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 835.930588] nova-scheduler[51959]: DEBUG nova.filters [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 835.930751] nova-scheduler[51959]: DEBUG nova.filters [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 835.930917] nova-scheduler[51959]: DEBUG nova.filters [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 835.931103] nova-scheduler[51959]: DEBUG nova.filters [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 835.931264] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 835.931447] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 835.931624] nova-scheduler[51959]: DEBUG nova.scheduler.utils [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Attempting to claim resources in the placement API for instance f3566a4b-8fe0-4c85-9c45-7c67cfd30323 {{(pid=51959) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 835.985163] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] [instance: f3566a4b-8fe0-4c85-9c45-7c67cfd30323] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=51959) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 835.985475] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 835.985685] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 835.985893] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-ef99a399-6c92-4b84-a789-c45fb6281616 tempest-AttachVolumeTestJSON-281399721 tempest-AttachVolumeTestJSON-281399721-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 860.846245] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-9df83d28-f286-4e1d-bd7a-eccbf738645e tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 860.846608] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-9df83d28-f286-4e1d-bd7a-eccbf738645e tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 860.846679] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-9df83d28-f286-4e1d-bd7a-eccbf738645e tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 860.846954] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9df83d28-f286-4e1d-bd7a-eccbf738645e tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 860.847267] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9df83d28-f286-4e1d-bd7a-eccbf738645e tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 860.847445] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9df83d28-f286-4e1d-bd7a-eccbf738645e tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 863.116723] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Starting to schedule for instances: ['c0f7ff03-5203-418d-aa9e-420448e9dbfb'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 863.117037] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 863.117186] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 863.117374] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 863.117584] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 863.117782] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 863.157311] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 863.157536] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 863.157708] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 863.164564] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 863.164769] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 863.165136] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='17',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='1',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_proj_eb70c075cb2e4c44917d5ba6cb849786='0',num_task_None='1',num_task_deleting='4',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:07:51Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=5) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 863.165420] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 863.165587] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 7, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 7, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 863.165741] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Update host state with instances: ['426f9016-4e69-4e46-87f6-a67f77da5dff', 'ae25fbd0-3770-43fc-9850-cdb2065b5ce3', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 863.165901] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 863.166166] nova-scheduler[51961]: DEBUG nova.filters [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 863.166374] nova-scheduler[51961]: DEBUG nova.filters [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 863.166558] nova-scheduler[51961]: DEBUG nova.filters [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 863.166753] nova-scheduler[51961]: DEBUG nova.filters [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 863.166922] nova-scheduler[51961]: DEBUG nova.filters [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 863.167121] nova-scheduler[51961]: DEBUG nova.filters [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 863.167304] nova-scheduler[51961]: DEBUG nova.filters [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 863.167471] nova-scheduler[51961]: DEBUG nova.filters [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 863.167629] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 863.167798] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 863.167971] nova-scheduler[51961]: DEBUG nova.scheduler.utils [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Attempting to claim resources in the placement API for instance c0f7ff03-5203-418d-aa9e-420448e9dbfb {{(pid=51961) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 863.209811] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] [instance: c0f7ff03-5203-418d-aa9e-420448e9dbfb] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=51961) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 863.210103] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 863.210310] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 863.210503] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c7fbca0e-03d3-4e50-a6be-f7c68dcb4b8d tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 909.260432] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-4adae7d0-8953-44ee-a2d7-808576aac9f2 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 909.260760] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-4adae7d0-8953-44ee-a2d7-808576aac9f2 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 909.261772] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-4adae7d0-8953-44ee-a2d7-808576aac9f2 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 909.262030] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-4adae7d0-8953-44ee-a2d7-808576aac9f2 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 909.262082] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-4adae7d0-8953-44ee-a2d7-808576aac9f2 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 909.262082] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-4adae7d0-8953-44ee-a2d7-808576aac9f2 tempest-ServersAdmin275Test-1044309481 tempest-ServersAdmin275Test-1044309481-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 915.264563] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-c5dd0f67-52fe-405e-a120-56679c3a1218 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Starting to schedule for instances: ['975b5459-fdb6-4194-85de-1b0c0115d53b'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 915.265088] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-c5dd0f67-52fe-405e-a120-56679c3a1218 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 915.265088] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-c5dd0f67-52fe-405e-a120-56679c3a1218 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 915.265250] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-c5dd0f67-52fe-405e-a120-56679c3a1218 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 915.265486] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-c5dd0f67-52fe-405e-a120-56679c3a1218 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 915.265684] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-c5dd0f67-52fe-405e-a120-56679c3a1218 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 915.309759] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-c5dd0f67-52fe-405e-a120-56679c3a1218 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 915.309985] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-c5dd0f67-52fe-405e-a120-56679c3a1218 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 915.310168] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-c5dd0f67-52fe-405e-a120-56679c3a1218 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 915.316854] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-c5dd0f67-52fe-405e-a120-56679c3a1218 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 915.317099] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-c5dd0f67-52fe-405e-a120-56679c3a1218 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 915.317470] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-c5dd0f67-52fe-405e-a120-56679c3a1218 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='18',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='0',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_task_None='1',num_task_deleting='3',num_task_spawning='1',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:08:40Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=5) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 915.317753] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-c5dd0f67-52fe-405e-a120-56679c3a1218 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 915.317923] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-c5dd0f67-52fe-405e-a120-56679c3a1218 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 7, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 7, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 915.318474] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-c5dd0f67-52fe-405e-a120-56679c3a1218 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Update host state with instances: ['426f9016-4e69-4e46-87f6-a67f77da5dff', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 915.318671] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-c5dd0f67-52fe-405e-a120-56679c3a1218 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 915.318947] nova-scheduler[51959]: DEBUG nova.filters [None req-c5dd0f67-52fe-405e-a120-56679c3a1218 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 915.319207] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-c5dd0f67-52fe-405e-a120-56679c3a1218 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:07:25. Elapsed time is 81.181411 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 915.319428] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-c5dd0f67-52fe-405e-a120-56679c3a1218 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 915.319560] nova-scheduler[51959]: INFO nova.filters [None req-c5dd0f67-52fe-405e-a120-56679c3a1218 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Filter ComputeFilter returned 0 hosts [ 915.319683] nova-scheduler[51959]: DEBUG nova.filters [None req-c5dd0f67-52fe-405e-a120-56679c3a1218 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Filtering removed all hosts for the request with instance ID '975b5459-fdb6-4194-85de-1b0c0115d53b'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 915.319796] nova-scheduler[51959]: INFO nova.filters [None req-c5dd0f67-52fe-405e-a120-56679c3a1218 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Filtering removed all hosts for the request with instance ID '975b5459-fdb6-4194-85de-1b0c0115d53b'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 915.319940] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-c5dd0f67-52fe-405e-a120-56679c3a1218 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 915.320141] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-c5dd0f67-52fe-405e-a120-56679c3a1218 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 915.815837] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-9778ba32-7af2-4eac-8717-07db5a69dbb2 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Starting to schedule for instances: ['62d8d399-e0e3-4557-af64-0caf823c6906'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 915.819165] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-9778ba32-7af2-4eac-8717-07db5a69dbb2 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 915.819165] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-9778ba32-7af2-4eac-8717-07db5a69dbb2 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 915.819165] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-9778ba32-7af2-4eac-8717-07db5a69dbb2 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 915.819165] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-9778ba32-7af2-4eac-8717-07db5a69dbb2 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 915.819165] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-9778ba32-7af2-4eac-8717-07db5a69dbb2 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 915.868149] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9778ba32-7af2-4eac-8717-07db5a69dbb2 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 915.868149] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9778ba32-7af2-4eac-8717-07db5a69dbb2 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 915.868596] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9778ba32-7af2-4eac-8717-07db5a69dbb2 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 915.881279] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9778ba32-7af2-4eac-8717-07db5a69dbb2 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 915.881407] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9778ba32-7af2-4eac-8717-07db5a69dbb2 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 915.881676] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-9778ba32-7af2-4eac-8717-07db5a69dbb2 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='18',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='0',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_task_None='1',num_task_deleting='3',num_task_spawning='1',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:08:40Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=5) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 915.881968] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-9778ba32-7af2-4eac-8717-07db5a69dbb2 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 915.882150] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-9778ba32-7af2-4eac-8717-07db5a69dbb2 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 7, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 7, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 915.882632] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-9778ba32-7af2-4eac-8717-07db5a69dbb2 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Update host state with instances: ['426f9016-4e69-4e46-87f6-a67f77da5dff', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 915.882843] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9778ba32-7af2-4eac-8717-07db5a69dbb2 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 915.883131] nova-scheduler[51961]: DEBUG nova.filters [None req-9778ba32-7af2-4eac-8717-07db5a69dbb2 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 915.883350] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-9778ba32-7af2-4eac-8717-07db5a69dbb2 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:07:25. Elapsed time is 81.74559 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 915.883894] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-9778ba32-7af2-4eac-8717-07db5a69dbb2 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 915.884102] nova-scheduler[51961]: INFO nova.filters [None req-9778ba32-7af2-4eac-8717-07db5a69dbb2 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Filter ComputeFilter returned 0 hosts [ 915.884266] nova-scheduler[51961]: DEBUG nova.filters [None req-9778ba32-7af2-4eac-8717-07db5a69dbb2 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Filtering removed all hosts for the request with instance ID '62d8d399-e0e3-4557-af64-0caf823c6906'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 915.884434] nova-scheduler[51961]: INFO nova.filters [None req-9778ba32-7af2-4eac-8717-07db5a69dbb2 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Filtering removed all hosts for the request with instance ID '62d8d399-e0e3-4557-af64-0caf823c6906'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 915.886237] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-9778ba32-7af2-4eac-8717-07db5a69dbb2 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 915.886237] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-9778ba32-7af2-4eac-8717-07db5a69dbb2 tempest-ServerRescueNegativeTestJSON-515251200 tempest-ServerRescueNegativeTestJSON-515251200-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 916.964020] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-06468cd9-4ab8-4742-b718-8768089eb035 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862-project-member] Starting to schedule for instances: ['15b9ac1a-5d95-41e9-a1c3-48884dcf16e5'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 916.964020] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-06468cd9-4ab8-4742-b718-8768089eb035 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 916.964020] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-06468cd9-4ab8-4742-b718-8768089eb035 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 916.964020] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-06468cd9-4ab8-4742-b718-8768089eb035 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 916.964020] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-06468cd9-4ab8-4742-b718-8768089eb035 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 916.964706] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-06468cd9-4ab8-4742-b718-8768089eb035 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 917.022270] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-06468cd9-4ab8-4742-b718-8768089eb035 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 917.022610] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-06468cd9-4ab8-4742-b718-8768089eb035 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 917.022819] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-06468cd9-4ab8-4742-b718-8768089eb035 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 917.030023] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-06468cd9-4ab8-4742-b718-8768089eb035 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 917.030023] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-06468cd9-4ab8-4742-b718-8768089eb035 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 917.030023] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-06468cd9-4ab8-4742-b718-8768089eb035 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='18',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='0',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_task_None='1',num_task_deleting='3',num_task_spawning='1',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:08:40Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=5) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 917.030408] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-06468cd9-4ab8-4742-b718-8768089eb035 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 917.030616] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-06468cd9-4ab8-4742-b718-8768089eb035 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 7, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 7, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 917.030824] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-06468cd9-4ab8-4742-b718-8768089eb035 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862-project-member] Update host state with instances: ['426f9016-4e69-4e46-87f6-a67f77da5dff', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 917.035056] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-06468cd9-4ab8-4742-b718-8768089eb035 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 917.035437] nova-scheduler[51959]: DEBUG nova.filters [None req-06468cd9-4ab8-4742-b718-8768089eb035 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 917.035671] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-06468cd9-4ab8-4742-b718-8768089eb035 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:07:25. Elapsed time is 82.897879 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 917.035836] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-06468cd9-4ab8-4742-b718-8768089eb035 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 917.035989] nova-scheduler[51959]: INFO nova.filters [None req-06468cd9-4ab8-4742-b718-8768089eb035 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862-project-member] Filter ComputeFilter returned 0 hosts [ 917.036161] nova-scheduler[51959]: DEBUG nova.filters [None req-06468cd9-4ab8-4742-b718-8768089eb035 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862-project-member] Filtering removed all hosts for the request with instance ID '15b9ac1a-5d95-41e9-a1c3-48884dcf16e5'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 917.036302] nova-scheduler[51959]: INFO nova.filters [None req-06468cd9-4ab8-4742-b718-8768089eb035 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862-project-member] Filtering removed all hosts for the request with instance ID '15b9ac1a-5d95-41e9-a1c3-48884dcf16e5'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 917.036452] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-06468cd9-4ab8-4742-b718-8768089eb035 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 917.036598] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-06468cd9-4ab8-4742-b718-8768089eb035 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862 tempest-FloatingIPsAssociationNegativeTestJSON-1684262862-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 918.744132] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-9510b341-a70c-4f04-b91f-e358e35cccb1 tempest-InstanceActionsNegativeTestJSON-2005392144 tempest-InstanceActionsNegativeTestJSON-2005392144-project-member] Starting to schedule for instances: ['9ba4a84b-2dbf-4322-971b-0d6cb5b21f07'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 918.747402] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-9510b341-a70c-4f04-b91f-e358e35cccb1 tempest-InstanceActionsNegativeTestJSON-2005392144 tempest-InstanceActionsNegativeTestJSON-2005392144-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 918.747700] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-9510b341-a70c-4f04-b91f-e358e35cccb1 tempest-InstanceActionsNegativeTestJSON-2005392144 tempest-InstanceActionsNegativeTestJSON-2005392144-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 918.747973] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-9510b341-a70c-4f04-b91f-e358e35cccb1 tempest-InstanceActionsNegativeTestJSON-2005392144 tempest-InstanceActionsNegativeTestJSON-2005392144-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 918.748303] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-9510b341-a70c-4f04-b91f-e358e35cccb1 tempest-InstanceActionsNegativeTestJSON-2005392144 tempest-InstanceActionsNegativeTestJSON-2005392144-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 918.748590] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-9510b341-a70c-4f04-b91f-e358e35cccb1 tempest-InstanceActionsNegativeTestJSON-2005392144 tempest-InstanceActionsNegativeTestJSON-2005392144-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 918.800863] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9510b341-a70c-4f04-b91f-e358e35cccb1 tempest-InstanceActionsNegativeTestJSON-2005392144 tempest-InstanceActionsNegativeTestJSON-2005392144-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 918.801114] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9510b341-a70c-4f04-b91f-e358e35cccb1 tempest-InstanceActionsNegativeTestJSON-2005392144 tempest-InstanceActionsNegativeTestJSON-2005392144-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 918.801297] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9510b341-a70c-4f04-b91f-e358e35cccb1 tempest-InstanceActionsNegativeTestJSON-2005392144 tempest-InstanceActionsNegativeTestJSON-2005392144-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 918.810154] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9510b341-a70c-4f04-b91f-e358e35cccb1 tempest-InstanceActionsNegativeTestJSON-2005392144 tempest-InstanceActionsNegativeTestJSON-2005392144-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 918.810154] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9510b341-a70c-4f04-b91f-e358e35cccb1 tempest-InstanceActionsNegativeTestJSON-2005392144 tempest-InstanceActionsNegativeTestJSON-2005392144-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 918.810535] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-9510b341-a70c-4f04-b91f-e358e35cccb1 tempest-InstanceActionsNegativeTestJSON-2005392144 tempest-InstanceActionsNegativeTestJSON-2005392144-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='18',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='0',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_task_None='1',num_task_deleting='3',num_task_spawning='1',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:08:40Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=5) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 918.810829] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-9510b341-a70c-4f04-b91f-e358e35cccb1 tempest-InstanceActionsNegativeTestJSON-2005392144 tempest-InstanceActionsNegativeTestJSON-2005392144-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 918.811009] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-9510b341-a70c-4f04-b91f-e358e35cccb1 tempest-InstanceActionsNegativeTestJSON-2005392144 tempest-InstanceActionsNegativeTestJSON-2005392144-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 7, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 7, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 918.811175] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-9510b341-a70c-4f04-b91f-e358e35cccb1 tempest-InstanceActionsNegativeTestJSON-2005392144 tempest-InstanceActionsNegativeTestJSON-2005392144-project-member] Update host state with instances: ['426f9016-4e69-4e46-87f6-a67f77da5dff', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 918.811342] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-9510b341-a70c-4f04-b91f-e358e35cccb1 tempest-InstanceActionsNegativeTestJSON-2005392144 tempest-InstanceActionsNegativeTestJSON-2005392144-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 918.811607] nova-scheduler[51961]: DEBUG nova.filters [None req-9510b341-a70c-4f04-b91f-e358e35cccb1 tempest-InstanceActionsNegativeTestJSON-2005392144 tempest-InstanceActionsNegativeTestJSON-2005392144-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 918.811933] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-9510b341-a70c-4f04-b91f-e358e35cccb1 tempest-InstanceActionsNegativeTestJSON-2005392144 tempest-InstanceActionsNegativeTestJSON-2005392144-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:07:25. Elapsed time is 84.674063 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 918.814719] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-9510b341-a70c-4f04-b91f-e358e35cccb1 tempest-InstanceActionsNegativeTestJSON-2005392144 tempest-InstanceActionsNegativeTestJSON-2005392144-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 918.814902] nova-scheduler[51961]: INFO nova.filters [None req-9510b341-a70c-4f04-b91f-e358e35cccb1 tempest-InstanceActionsNegativeTestJSON-2005392144 tempest-InstanceActionsNegativeTestJSON-2005392144-project-member] Filter ComputeFilter returned 0 hosts [ 918.815279] nova-scheduler[51961]: DEBUG nova.filters [None req-9510b341-a70c-4f04-b91f-e358e35cccb1 tempest-InstanceActionsNegativeTestJSON-2005392144 tempest-InstanceActionsNegativeTestJSON-2005392144-project-member] Filtering removed all hosts for the request with instance ID '9ba4a84b-2dbf-4322-971b-0d6cb5b21f07'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 918.815279] nova-scheduler[51961]: INFO nova.filters [None req-9510b341-a70c-4f04-b91f-e358e35cccb1 tempest-InstanceActionsNegativeTestJSON-2005392144 tempest-InstanceActionsNegativeTestJSON-2005392144-project-member] Filtering removed all hosts for the request with instance ID '9ba4a84b-2dbf-4322-971b-0d6cb5b21f07'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 918.816371] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-9510b341-a70c-4f04-b91f-e358e35cccb1 tempest-InstanceActionsNegativeTestJSON-2005392144 tempest-InstanceActionsNegativeTestJSON-2005392144-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 918.816371] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-9510b341-a70c-4f04-b91f-e358e35cccb1 tempest-InstanceActionsNegativeTestJSON-2005392144 tempest-InstanceActionsNegativeTestJSON-2005392144-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 929.441823] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-7eebab9f-d037-4787-b6c0-e7b186fbf5e9 tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Starting to schedule for instances: ['90d1dfae-4870-47d3-aec5-0a028d20b71f'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 929.442190] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-7eebab9f-d037-4787-b6c0-e7b186fbf5e9 tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 929.442525] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-7eebab9f-d037-4787-b6c0-e7b186fbf5e9 tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 929.442828] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-7eebab9f-d037-4787-b6c0-e7b186fbf5e9 tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 929.443067] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-7eebab9f-d037-4787-b6c0-e7b186fbf5e9 tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 929.445034] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-7eebab9f-d037-4787-b6c0-e7b186fbf5e9 tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 929.483896] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-7eebab9f-d037-4787-b6c0-e7b186fbf5e9 tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 929.483896] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-7eebab9f-d037-4787-b6c0-e7b186fbf5e9 tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 929.484089] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-7eebab9f-d037-4787-b6c0-e7b186fbf5e9 tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 929.490652] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-7eebab9f-d037-4787-b6c0-e7b186fbf5e9 tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 929.490860] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-7eebab9f-d037-4787-b6c0-e7b186fbf5e9 tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 929.491314] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-7eebab9f-d037-4787-b6c0-e7b186fbf5e9 tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='18',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='0',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_task_None='1',num_task_deleting='3',num_task_spawning='1',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:08:40Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=5) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 929.491501] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-7eebab9f-d037-4787-b6c0-e7b186fbf5e9 tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 929.491676] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-7eebab9f-d037-4787-b6c0-e7b186fbf5e9 tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 7, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 7, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 929.491831] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-7eebab9f-d037-4787-b6c0-e7b186fbf5e9 tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Update host state with instances: ['426f9016-4e69-4e46-87f6-a67f77da5dff', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 929.491995] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-7eebab9f-d037-4787-b6c0-e7b186fbf5e9 tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 929.492331] nova-scheduler[51959]: DEBUG nova.filters [None req-7eebab9f-d037-4787-b6c0-e7b186fbf5e9 tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 929.492516] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-7eebab9f-d037-4787-b6c0-e7b186fbf5e9 tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:07:25. Elapsed time is 95.354729 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 929.492689] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-7eebab9f-d037-4787-b6c0-e7b186fbf5e9 tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 929.492846] nova-scheduler[51959]: INFO nova.filters [None req-7eebab9f-d037-4787-b6c0-e7b186fbf5e9 tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Filter ComputeFilter returned 0 hosts [ 929.492994] nova-scheduler[51959]: DEBUG nova.filters [None req-7eebab9f-d037-4787-b6c0-e7b186fbf5e9 tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Filtering removed all hosts for the request with instance ID '90d1dfae-4870-47d3-aec5-0a028d20b71f'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 929.493145] nova-scheduler[51959]: INFO nova.filters [None req-7eebab9f-d037-4787-b6c0-e7b186fbf5e9 tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Filtering removed all hosts for the request with instance ID '90d1dfae-4870-47d3-aec5-0a028d20b71f'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 929.493371] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-7eebab9f-d037-4787-b6c0-e7b186fbf5e9 tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 929.493428] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-7eebab9f-d037-4787-b6c0-e7b186fbf5e9 tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 933.052152] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-687bf314-44f6-4d8d-a845-521e166ac51a tempest-InstanceActionsTestJSON-2091493268 tempest-InstanceActionsTestJSON-2091493268-project-member] Starting to schedule for instances: ['67567d03-d3f9-4d91-bb86-00545d7ccd93'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 933.052152] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-687bf314-44f6-4d8d-a845-521e166ac51a tempest-InstanceActionsTestJSON-2091493268 tempest-InstanceActionsTestJSON-2091493268-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 933.052152] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-687bf314-44f6-4d8d-a845-521e166ac51a tempest-InstanceActionsTestJSON-2091493268 tempest-InstanceActionsTestJSON-2091493268-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 933.052742] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-687bf314-44f6-4d8d-a845-521e166ac51a tempest-InstanceActionsTestJSON-2091493268 tempest-InstanceActionsTestJSON-2091493268-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 933.053122] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-687bf314-44f6-4d8d-a845-521e166ac51a tempest-InstanceActionsTestJSON-2091493268 tempest-InstanceActionsTestJSON-2091493268-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 933.053421] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-687bf314-44f6-4d8d-a845-521e166ac51a tempest-InstanceActionsTestJSON-2091493268 tempest-InstanceActionsTestJSON-2091493268-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 933.096865] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-687bf314-44f6-4d8d-a845-521e166ac51a tempest-InstanceActionsTestJSON-2091493268 tempest-InstanceActionsTestJSON-2091493268-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 933.097398] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-687bf314-44f6-4d8d-a845-521e166ac51a tempest-InstanceActionsTestJSON-2091493268 tempest-InstanceActionsTestJSON-2091493268-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 933.097717] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-687bf314-44f6-4d8d-a845-521e166ac51a tempest-InstanceActionsTestJSON-2091493268 tempest-InstanceActionsTestJSON-2091493268-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 933.106134] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-687bf314-44f6-4d8d-a845-521e166ac51a tempest-InstanceActionsTestJSON-2091493268 tempest-InstanceActionsTestJSON-2091493268-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 933.106134] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-687bf314-44f6-4d8d-a845-521e166ac51a tempest-InstanceActionsTestJSON-2091493268 tempest-InstanceActionsTestJSON-2091493268-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 933.106523] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-687bf314-44f6-4d8d-a845-521e166ac51a tempest-InstanceActionsTestJSON-2091493268 tempest-InstanceActionsTestJSON-2091493268-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='18',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='0',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_task_None='1',num_task_deleting='3',num_task_spawning='1',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:08:40Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=5) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 933.108532] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-687bf314-44f6-4d8d-a845-521e166ac51a tempest-InstanceActionsTestJSON-2091493268 tempest-InstanceActionsTestJSON-2091493268-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 933.108532] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-687bf314-44f6-4d8d-a845-521e166ac51a tempest-InstanceActionsTestJSON-2091493268 tempest-InstanceActionsTestJSON-2091493268-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 7, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 7, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 933.108532] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-687bf314-44f6-4d8d-a845-521e166ac51a tempest-InstanceActionsTestJSON-2091493268 tempest-InstanceActionsTestJSON-2091493268-project-member] Update host state with instances: ['426f9016-4e69-4e46-87f6-a67f77da5dff', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 933.108532] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-687bf314-44f6-4d8d-a845-521e166ac51a tempest-InstanceActionsTestJSON-2091493268 tempest-InstanceActionsTestJSON-2091493268-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 933.108532] nova-scheduler[51961]: DEBUG nova.filters [None req-687bf314-44f6-4d8d-a845-521e166ac51a tempest-InstanceActionsTestJSON-2091493268 tempest-InstanceActionsTestJSON-2091493268-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 933.108532] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-687bf314-44f6-4d8d-a845-521e166ac51a tempest-InstanceActionsTestJSON-2091493268 tempest-InstanceActionsTestJSON-2091493268-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:07:25. Elapsed time is 98.970213 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 933.108532] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-687bf314-44f6-4d8d-a845-521e166ac51a tempest-InstanceActionsTestJSON-2091493268 tempest-InstanceActionsTestJSON-2091493268-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 933.108532] nova-scheduler[51961]: INFO nova.filters [None req-687bf314-44f6-4d8d-a845-521e166ac51a tempest-InstanceActionsTestJSON-2091493268 tempest-InstanceActionsTestJSON-2091493268-project-member] Filter ComputeFilter returned 0 hosts [ 933.108532] nova-scheduler[51961]: DEBUG nova.filters [None req-687bf314-44f6-4d8d-a845-521e166ac51a tempest-InstanceActionsTestJSON-2091493268 tempest-InstanceActionsTestJSON-2091493268-project-member] Filtering removed all hosts for the request with instance ID '67567d03-d3f9-4d91-bb86-00545d7ccd93'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 933.109868] nova-scheduler[51961]: INFO nova.filters [None req-687bf314-44f6-4d8d-a845-521e166ac51a tempest-InstanceActionsTestJSON-2091493268 tempest-InstanceActionsTestJSON-2091493268-project-member] Filtering removed all hosts for the request with instance ID '67567d03-d3f9-4d91-bb86-00545d7ccd93'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 933.109868] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-687bf314-44f6-4d8d-a845-521e166ac51a tempest-InstanceActionsTestJSON-2091493268 tempest-InstanceActionsTestJSON-2091493268-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 933.109868] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-687bf314-44f6-4d8d-a845-521e166ac51a tempest-InstanceActionsTestJSON-2091493268 tempest-InstanceActionsTestJSON-2091493268-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 933.567578] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-5cb92aa3-dd77-4b2a-9580-13d61acf1dfc tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Starting to schedule for instances: ['b86bcb13-a4cb-4d3b-a705-bfec85bab98a'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 933.568038] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-5cb92aa3-dd77-4b2a-9580-13d61acf1dfc tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 933.568224] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-5cb92aa3-dd77-4b2a-9580-13d61acf1dfc tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 933.568415] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-5cb92aa3-dd77-4b2a-9580-13d61acf1dfc tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 933.569046] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-5cb92aa3-dd77-4b2a-9580-13d61acf1dfc tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 933.569046] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-5cb92aa3-dd77-4b2a-9580-13d61acf1dfc tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 933.608855] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-5cb92aa3-dd77-4b2a-9580-13d61acf1dfc tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 933.609098] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-5cb92aa3-dd77-4b2a-9580-13d61acf1dfc tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 933.609269] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-5cb92aa3-dd77-4b2a-9580-13d61acf1dfc tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 933.616539] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-5cb92aa3-dd77-4b2a-9580-13d61acf1dfc tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 933.616762] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-5cb92aa3-dd77-4b2a-9580-13d61acf1dfc tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 933.617154] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-5cb92aa3-dd77-4b2a-9580-13d61acf1dfc tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='18',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='0',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_task_None='1',num_task_deleting='3',num_task_spawning='1',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:08:40Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=5) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 933.617436] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-5cb92aa3-dd77-4b2a-9580-13d61acf1dfc tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 933.617605] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-5cb92aa3-dd77-4b2a-9580-13d61acf1dfc tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 7, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 7, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 933.617764] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-5cb92aa3-dd77-4b2a-9580-13d61acf1dfc tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Update host state with instances: ['426f9016-4e69-4e46-87f6-a67f77da5dff', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 933.617928] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-5cb92aa3-dd77-4b2a-9580-13d61acf1dfc tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 933.618204] nova-scheduler[51959]: DEBUG nova.filters [None req-5cb92aa3-dd77-4b2a-9580-13d61acf1dfc tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 933.618416] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-5cb92aa3-dd77-4b2a-9580-13d61acf1dfc tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:07:25. Elapsed time is 99.480658 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 933.618575] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-5cb92aa3-dd77-4b2a-9580-13d61acf1dfc tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 933.618728] nova-scheduler[51959]: INFO nova.filters [None req-5cb92aa3-dd77-4b2a-9580-13d61acf1dfc tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Filter ComputeFilter returned 0 hosts [ 933.618877] nova-scheduler[51959]: DEBUG nova.filters [None req-5cb92aa3-dd77-4b2a-9580-13d61acf1dfc tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Filtering removed all hosts for the request with instance ID 'b86bcb13-a4cb-4d3b-a705-bfec85bab98a'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 933.619027] nova-scheduler[51959]: INFO nova.filters [None req-5cb92aa3-dd77-4b2a-9580-13d61acf1dfc tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Filtering removed all hosts for the request with instance ID 'b86bcb13-a4cb-4d3b-a705-bfec85bab98a'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 933.619178] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-5cb92aa3-dd77-4b2a-9580-13d61acf1dfc tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 933.619323] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-5cb92aa3-dd77-4b2a-9580-13d61acf1dfc tempest-SecurityGroupsTestJSON-2074217135 tempest-SecurityGroupsTestJSON-2074217135-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 940.024385] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-10469c58-cbdc-4189-b61d-aba3c030b185 tempest-ServerRescueTestJSON-337503008 tempest-ServerRescueTestJSON-337503008-project-member] Starting to schedule for instances: ['8c8cf939-4ff4-42ed-a9fd-1908e95ba35c'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 940.024783] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-10469c58-cbdc-4189-b61d-aba3c030b185 tempest-ServerRescueTestJSON-337503008 tempest-ServerRescueTestJSON-337503008-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 940.024957] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-10469c58-cbdc-4189-b61d-aba3c030b185 tempest-ServerRescueTestJSON-337503008 tempest-ServerRescueTestJSON-337503008-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 940.025160] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-10469c58-cbdc-4189-b61d-aba3c030b185 tempest-ServerRescueTestJSON-337503008 tempest-ServerRescueTestJSON-337503008-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 940.025357] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-10469c58-cbdc-4189-b61d-aba3c030b185 tempest-ServerRescueTestJSON-337503008 tempest-ServerRescueTestJSON-337503008-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 940.025535] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-10469c58-cbdc-4189-b61d-aba3c030b185 tempest-ServerRescueTestJSON-337503008 tempest-ServerRescueTestJSON-337503008-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 940.068404] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-10469c58-cbdc-4189-b61d-aba3c030b185 tempest-ServerRescueTestJSON-337503008 tempest-ServerRescueTestJSON-337503008-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 940.068639] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-10469c58-cbdc-4189-b61d-aba3c030b185 tempest-ServerRescueTestJSON-337503008 tempest-ServerRescueTestJSON-337503008-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 940.068811] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-10469c58-cbdc-4189-b61d-aba3c030b185 tempest-ServerRescueTestJSON-337503008 tempest-ServerRescueTestJSON-337503008-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 940.075904] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-10469c58-cbdc-4189-b61d-aba3c030b185 tempest-ServerRescueTestJSON-337503008 tempest-ServerRescueTestJSON-337503008-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 940.076135] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-10469c58-cbdc-4189-b61d-aba3c030b185 tempest-ServerRescueTestJSON-337503008 tempest-ServerRescueTestJSON-337503008-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 940.076496] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-10469c58-cbdc-4189-b61d-aba3c030b185 tempest-ServerRescueTestJSON-337503008 tempest-ServerRescueTestJSON-337503008-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='18',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='0',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_task_None='1',num_task_deleting='3',num_task_spawning='1',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:08:40Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=5) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 940.076778] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-10469c58-cbdc-4189-b61d-aba3c030b185 tempest-ServerRescueTestJSON-337503008 tempest-ServerRescueTestJSON-337503008-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 940.076949] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-10469c58-cbdc-4189-b61d-aba3c030b185 tempest-ServerRescueTestJSON-337503008 tempest-ServerRescueTestJSON-337503008-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 7, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 7, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 940.077127] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-10469c58-cbdc-4189-b61d-aba3c030b185 tempest-ServerRescueTestJSON-337503008 tempest-ServerRescueTestJSON-337503008-project-member] Update host state with instances: ['426f9016-4e69-4e46-87f6-a67f77da5dff', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 940.077293] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-10469c58-cbdc-4189-b61d-aba3c030b185 tempest-ServerRescueTestJSON-337503008 tempest-ServerRescueTestJSON-337503008-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 940.077546] nova-scheduler[51961]: DEBUG nova.filters [None req-10469c58-cbdc-4189-b61d-aba3c030b185 tempest-ServerRescueTestJSON-337503008 tempest-ServerRescueTestJSON-337503008-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 940.077751] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-10469c58-cbdc-4189-b61d-aba3c030b185 tempest-ServerRescueTestJSON-337503008 tempest-ServerRescueTestJSON-337503008-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:07:25. Elapsed time is 105.939996 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 940.077907] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-10469c58-cbdc-4189-b61d-aba3c030b185 tempest-ServerRescueTestJSON-337503008 tempest-ServerRescueTestJSON-337503008-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 940.078069] nova-scheduler[51961]: INFO nova.filters [None req-10469c58-cbdc-4189-b61d-aba3c030b185 tempest-ServerRescueTestJSON-337503008 tempest-ServerRescueTestJSON-337503008-project-member] Filter ComputeFilter returned 0 hosts [ 940.078222] nova-scheduler[51961]: DEBUG nova.filters [None req-10469c58-cbdc-4189-b61d-aba3c030b185 tempest-ServerRescueTestJSON-337503008 tempest-ServerRescueTestJSON-337503008-project-member] Filtering removed all hosts for the request with instance ID '8c8cf939-4ff4-42ed-a9fd-1908e95ba35c'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 940.078360] nova-scheduler[51961]: INFO nova.filters [None req-10469c58-cbdc-4189-b61d-aba3c030b185 tempest-ServerRescueTestJSON-337503008 tempest-ServerRescueTestJSON-337503008-project-member] Filtering removed all hosts for the request with instance ID '8c8cf939-4ff4-42ed-a9fd-1908e95ba35c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 940.078509] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-10469c58-cbdc-4189-b61d-aba3c030b185 tempest-ServerRescueTestJSON-337503008 tempest-ServerRescueTestJSON-337503008-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 940.078666] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-10469c58-cbdc-4189-b61d-aba3c030b185 tempest-ServerRescueTestJSON-337503008 tempest-ServerRescueTestJSON-337503008-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 946.353478] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-3500ee8a-a6e1-4269-9d66-1b7147f95646 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Starting to schedule for instances: ['1068a8ce-c582-4613-954f-be4b11bd3453'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 946.353948] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-3500ee8a-a6e1-4269-9d66-1b7147f95646 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 946.353948] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-3500ee8a-a6e1-4269-9d66-1b7147f95646 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 946.354141] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-3500ee8a-a6e1-4269-9d66-1b7147f95646 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 946.354366] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-3500ee8a-a6e1-4269-9d66-1b7147f95646 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 946.354599] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-3500ee8a-a6e1-4269-9d66-1b7147f95646 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 946.400047] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-3500ee8a-a6e1-4269-9d66-1b7147f95646 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 946.400253] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-3500ee8a-a6e1-4269-9d66-1b7147f95646 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 946.400424] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-3500ee8a-a6e1-4269-9d66-1b7147f95646 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 946.407584] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-3500ee8a-a6e1-4269-9d66-1b7147f95646 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 946.407864] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-3500ee8a-a6e1-4269-9d66-1b7147f95646 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 946.408783] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-3500ee8a-a6e1-4269-9d66-1b7147f95646 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='18',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='0',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_task_None='1',num_task_deleting='3',num_task_spawning='1',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:08:40Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=5) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 946.408783] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-3500ee8a-a6e1-4269-9d66-1b7147f95646 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 946.408966] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-3500ee8a-a6e1-4269-9d66-1b7147f95646 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 7, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 7, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 946.409876] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-3500ee8a-a6e1-4269-9d66-1b7147f95646 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Update host state with instances: ['426f9016-4e69-4e46-87f6-a67f77da5dff', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 946.410638] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-3500ee8a-a6e1-4269-9d66-1b7147f95646 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 946.410993] nova-scheduler[51959]: DEBUG nova.filters [None req-3500ee8a-a6e1-4269-9d66-1b7147f95646 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 946.411369] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-3500ee8a-a6e1-4269-9d66-1b7147f95646 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:07:25. Elapsed time is 112.273498 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 946.411607] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-3500ee8a-a6e1-4269-9d66-1b7147f95646 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 946.412025] nova-scheduler[51959]: INFO nova.filters [None req-3500ee8a-a6e1-4269-9d66-1b7147f95646 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Filter ComputeFilter returned 0 hosts [ 946.412025] nova-scheduler[51959]: DEBUG nova.filters [None req-3500ee8a-a6e1-4269-9d66-1b7147f95646 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Filtering removed all hosts for the request with instance ID '1068a8ce-c582-4613-954f-be4b11bd3453'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 946.412099] nova-scheduler[51959]: INFO nova.filters [None req-3500ee8a-a6e1-4269-9d66-1b7147f95646 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Filtering removed all hosts for the request with instance ID '1068a8ce-c582-4613-954f-be4b11bd3453'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 946.412206] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-3500ee8a-a6e1-4269-9d66-1b7147f95646 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 946.412352] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-3500ee8a-a6e1-4269-9d66-1b7147f95646 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 948.818864] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-c21170e9-3c79-4c2c-9147-5e2d582d856f tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Starting to schedule for instances: ['d1f897a5-db67-47c0-94ea-7f53b39660ce'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 948.819308] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c21170e9-3c79-4c2c-9147-5e2d582d856f tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 948.819536] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c21170e9-3c79-4c2c-9147-5e2d582d856f tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 948.819785] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c21170e9-3c79-4c2c-9147-5e2d582d856f tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 948.820072] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c21170e9-3c79-4c2c-9147-5e2d582d856f tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 948.820281] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-c21170e9-3c79-4c2c-9147-5e2d582d856f tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 948.860549] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c21170e9-3c79-4c2c-9147-5e2d582d856f tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 948.860784] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c21170e9-3c79-4c2c-9147-5e2d582d856f tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 948.860955] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c21170e9-3c79-4c2c-9147-5e2d582d856f tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 948.867718] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c21170e9-3c79-4c2c-9147-5e2d582d856f tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 948.867928] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c21170e9-3c79-4c2c-9147-5e2d582d856f tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 948.868288] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-c21170e9-3c79-4c2c-9147-5e2d582d856f tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='18',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='0',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_task_None='1',num_task_deleting='3',num_task_spawning='1',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:08:40Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=5) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 948.868568] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-c21170e9-3c79-4c2c-9147-5e2d582d856f tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 948.868743] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-c21170e9-3c79-4c2c-9147-5e2d582d856f tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 7, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 7, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 948.868903] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-c21170e9-3c79-4c2c-9147-5e2d582d856f tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Update host state with instances: ['426f9016-4e69-4e46-87f6-a67f77da5dff', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 948.869082] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-c21170e9-3c79-4c2c-9147-5e2d582d856f tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 948.869328] nova-scheduler[51961]: DEBUG nova.filters [None req-c21170e9-3c79-4c2c-9147-5e2d582d856f tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 948.869532] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-c21170e9-3c79-4c2c-9147-5e2d582d856f tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:07:25. Elapsed time is 114.731779 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 948.869692] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-c21170e9-3c79-4c2c-9147-5e2d582d856f tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 948.869843] nova-scheduler[51961]: INFO nova.filters [None req-c21170e9-3c79-4c2c-9147-5e2d582d856f tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Filter ComputeFilter returned 0 hosts [ 948.869991] nova-scheduler[51961]: DEBUG nova.filters [None req-c21170e9-3c79-4c2c-9147-5e2d582d856f tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Filtering removed all hosts for the request with instance ID 'd1f897a5-db67-47c0-94ea-7f53b39660ce'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 948.870146] nova-scheduler[51961]: INFO nova.filters [None req-c21170e9-3c79-4c2c-9147-5e2d582d856f tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Filtering removed all hosts for the request with instance ID 'd1f897a5-db67-47c0-94ea-7f53b39660ce'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 948.870294] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-c21170e9-3c79-4c2c-9147-5e2d582d856f tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 948.870439] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-c21170e9-3c79-4c2c-9147-5e2d582d856f tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 951.030456] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0b3d3250-619c-4372-9008-285b15b3066c None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 951.030673] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0b3d3250-619c-4372-9008-285b15b3066c None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 951.030834] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0b3d3250-619c-4372-9008-285b15b3066c None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 951.030967] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0b3d3250-619c-4372-9008-285b15b3066c None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 951.031157] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-0b3d3250-619c-4372-9008-285b15b3066c None None] Successfully synced instances from host 'cpu-1'. {{(pid=51961) sync_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:972}} [ 951.031322] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-0b3d3250-619c-4372-9008-285b15b3066c None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 951.032519] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-0b3d3250-619c-4372-9008-285b15b3066c None None] Successfully synced instances from host 'cpu-1'. {{(pid=51959) sync_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:972}} [ 951.032734] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-0b3d3250-619c-4372-9008-285b15b3066c None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.002s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 951.323978] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-9e4513a8-254a-4cee-b216-40f3dd541627 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Starting to schedule for instances: ['fc1a1038-af9b-4f60-ac57-4d7eba6bdef8'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 951.324292] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-9e4513a8-254a-4cee-b216-40f3dd541627 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 951.324455] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-9e4513a8-254a-4cee-b216-40f3dd541627 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 951.324661] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-9e4513a8-254a-4cee-b216-40f3dd541627 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 951.324873] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-9e4513a8-254a-4cee-b216-40f3dd541627 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 951.325062] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-9e4513a8-254a-4cee-b216-40f3dd541627 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 951.363171] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-9e4513a8-254a-4cee-b216-40f3dd541627 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 951.363396] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-9e4513a8-254a-4cee-b216-40f3dd541627 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 951.363565] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-9e4513a8-254a-4cee-b216-40f3dd541627 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 951.370065] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-9e4513a8-254a-4cee-b216-40f3dd541627 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 951.370274] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-9e4513a8-254a-4cee-b216-40f3dd541627 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 951.370619] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-9e4513a8-254a-4cee-b216-40f3dd541627 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='18',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_7913858bdbbe4375917c0e1864ee8d2e='1',num_proj_a07d0346e8884cf394bb87ea702ec039='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='2',num_proj_d32baf4d3cbd4e7ba0286e667138fcf2='0',num_proj_d3499ac5d4a9412e8e0d2db65c79c59c='1',num_task_None='1',num_task_deleting='3',num_task_spawning='1',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:08:40Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=5) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 951.370891] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-9e4513a8-254a-4cee-b216-40f3dd541627 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 951.371072] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-9e4513a8-254a-4cee-b216-40f3dd541627 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 7, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 7, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 951.371232] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-9e4513a8-254a-4cee-b216-40f3dd541627 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Update host state with instances: ['426f9016-4e69-4e46-87f6-a67f77da5dff', '27836d31-f379-4b4b-aed1-155f4a947779', 'ef011071-c0e1-44e0-9940-285f2f45da67'] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 951.371393] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-9e4513a8-254a-4cee-b216-40f3dd541627 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 951.371633] nova-scheduler[51959]: DEBUG nova.filters [None req-9e4513a8-254a-4cee-b216-40f3dd541627 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 951.371839] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-9e4513a8-254a-4cee-b216-40f3dd541627 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:07:25. Elapsed time is 117.234086 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 951.371994] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-9e4513a8-254a-4cee-b216-40f3dd541627 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 951.372163] nova-scheduler[51959]: INFO nova.filters [None req-9e4513a8-254a-4cee-b216-40f3dd541627 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Filter ComputeFilter returned 0 hosts [ 951.372306] nova-scheduler[51959]: DEBUG nova.filters [None req-9e4513a8-254a-4cee-b216-40f3dd541627 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Filtering removed all hosts for the request with instance ID 'fc1a1038-af9b-4f60-ac57-4d7eba6bdef8'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 951.372442] nova-scheduler[51959]: INFO nova.filters [None req-9e4513a8-254a-4cee-b216-40f3dd541627 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Filtering removed all hosts for the request with instance ID 'fc1a1038-af9b-4f60-ac57-4d7eba6bdef8'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 951.372588] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-9e4513a8-254a-4cee-b216-40f3dd541627 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 951.372734] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-9e4513a8-254a-4cee-b216-40f3dd541627 tempest-AttachVolumeNegativeTest-1010005069 tempest-AttachVolumeNegativeTest-1010005069-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 960.306761] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-3eaeb65a-a7b7-4bb5-9adb-a5c55e0138d2 tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 960.307073] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-3eaeb65a-a7b7-4bb5-9adb-a5c55e0138d2 tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 960.307218] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-3eaeb65a-a7b7-4bb5-9adb-a5c55e0138d2 tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 960.307218] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-3eaeb65a-a7b7-4bb5-9adb-a5c55e0138d2 tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 960.307434] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-3eaeb65a-a7b7-4bb5-9adb-a5c55e0138d2 tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 960.307641] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-3eaeb65a-a7b7-4bb5-9adb-a5c55e0138d2 tempest-ServerExternalEventsTest-1949741007 tempest-ServerExternalEventsTest-1949741007-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1008.058207] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-eac98843-925e-4a46-9b9e-3f83cab2f233 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1008.058447] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-eac98843-925e-4a46-9b9e-3f83cab2f233 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1008.059121] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-eac98843-925e-4a46-9b9e-3f83cab2f233 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1008.059121] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-eac98843-925e-4a46-9b9e-3f83cab2f233 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1008.059245] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-eac98843-925e-4a46-9b9e-3f83cab2f233 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1008.059245] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-eac98843-925e-4a46-9b9e-3f83cab2f233 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1055.855550] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-eb30c12c-594e-480a-aeed-7a14cf528a9c tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1055.855839] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-eb30c12c-594e-480a-aeed-7a14cf528a9c tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1055.856018] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-eb30c12c-594e-480a-aeed-7a14cf528a9c tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1055.856379] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-eb30c12c-594e-480a-aeed-7a14cf528a9c tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1055.856629] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-eb30c12c-594e-480a-aeed-7a14cf528a9c tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1055.856856] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-eb30c12c-594e-480a-aeed-7a14cf528a9c tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1057.098441] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-fc39e67f-3859-4ea7-9706-cc23c2272b73 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Starting to schedule for instances: ['2cd4487c-30bc-4b13-ab5e-0a000b537a84', '5049c203-f7eb-4601-8a7a-6accb278a9c9'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1057.098811] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-fc39e67f-3859-4ea7-9706-cc23c2272b73 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1057.099014] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-fc39e67f-3859-4ea7-9706-cc23c2272b73 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1057.099241] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-fc39e67f-3859-4ea7-9706-cc23c2272b73 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1057.099481] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-fc39e67f-3859-4ea7-9706-cc23c2272b73 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1057.099693] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-fc39e67f-3859-4ea7-9706-cc23c2272b73 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1057.139560] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-fc39e67f-3859-4ea7-9706-cc23c2272b73 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1057.139849] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-fc39e67f-3859-4ea7-9706-cc23c2272b73 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1057.140135] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-fc39e67f-3859-4ea7-9706-cc23c2272b73 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1057.146899] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-fc39e67f-3859-4ea7-9706-cc23c2272b73 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1057.147184] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-fc39e67f-3859-4ea7-9706-cc23c2272b73 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1057.147639] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-fc39e67f-3859-4ea7-9706-cc23c2272b73 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='20',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_581c2db844984c00bc0bad0475272109='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='0',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_deleting='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:11:06Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=2) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1057.147951] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-fc39e67f-3859-4ea7-9706-cc23c2272b73 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1057.148132] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-fc39e67f-3859-4ea7-9706-cc23c2272b73 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 5, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 9, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 9, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1057.148289] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-fc39e67f-3859-4ea7-9706-cc23c2272b73 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Update host state with instances: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1057.148451] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-fc39e67f-3859-4ea7-9706-cc23c2272b73 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1057.148697] nova-scheduler[51961]: DEBUG nova.filters [None req-fc39e67f-3859-4ea7-9706-cc23c2272b73 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1057.148906] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-fc39e67f-3859-4ea7-9706-cc23c2272b73 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:09:25. Elapsed time is 103.011151 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 1057.149071] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-fc39e67f-3859-4ea7-9706-cc23c2272b73 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 1057.149227] nova-scheduler[51961]: INFO nova.filters [None req-fc39e67f-3859-4ea7-9706-cc23c2272b73 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Filter ComputeFilter returned 0 hosts [ 1057.149376] nova-scheduler[51961]: DEBUG nova.filters [None req-fc39e67f-3859-4ea7-9706-cc23c2272b73 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Filtering removed all hosts for the request with instance ID '2cd4487c-30bc-4b13-ab5e-0a000b537a84'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 1057.149512] nova-scheduler[51961]: INFO nova.filters [None req-fc39e67f-3859-4ea7-9706-cc23c2272b73 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Filtering removed all hosts for the request with instance ID '2cd4487c-30bc-4b13-ab5e-0a000b537a84'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 1057.149661] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-fc39e67f-3859-4ea7-9706-cc23c2272b73 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1057.149817] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-fc39e67f-3859-4ea7-9706-cc23c2272b73 tempest-MultipleCreateTestJSON-359342352 tempest-MultipleCreateTestJSON-359342352-project-member] There are 0 hosts available but 2 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 1061.140235] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-a4c7b854-69d7-4ec9-b135-287fbeac9944 tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Starting to schedule for instances: ['9cc5100d-3f93-4aac-8eb8-71776f8d765d'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1061.140544] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-a4c7b854-69d7-4ec9-b135-287fbeac9944 tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1061.142852] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-a4c7b854-69d7-4ec9-b135-287fbeac9944 tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1061.143817] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-a4c7b854-69d7-4ec9-b135-287fbeac9944 tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1061.143817] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-a4c7b854-69d7-4ec9-b135-287fbeac9944 tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1061.143817] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-a4c7b854-69d7-4ec9-b135-287fbeac9944 tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1061.188538] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a4c7b854-69d7-4ec9-b135-287fbeac9944 tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1061.189092] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a4c7b854-69d7-4ec9-b135-287fbeac9944 tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1061.189277] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a4c7b854-69d7-4ec9-b135-287fbeac9944 tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1061.196173] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a4c7b854-69d7-4ec9-b135-287fbeac9944 tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1061.196381] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a4c7b854-69d7-4ec9-b135-287fbeac9944 tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1061.196738] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-a4c7b854-69d7-4ec9-b135-287fbeac9944 tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='20',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_581c2db844984c00bc0bad0475272109='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='0',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_deleting='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:11:06Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=2) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1061.197171] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-a4c7b854-69d7-4ec9-b135-287fbeac9944 tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1061.197365] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-a4c7b854-69d7-4ec9-b135-287fbeac9944 tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 5, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 9, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 9, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1061.197558] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-a4c7b854-69d7-4ec9-b135-287fbeac9944 tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Update host state with instances: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1061.197682] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-a4c7b854-69d7-4ec9-b135-287fbeac9944 tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1061.198008] nova-scheduler[51959]: DEBUG nova.filters [None req-a4c7b854-69d7-4ec9-b135-287fbeac9944 tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1061.198231] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-a4c7b854-69d7-4ec9-b135-287fbeac9944 tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:09:25. Elapsed time is 107.06047 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 1061.198389] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-a4c7b854-69d7-4ec9-b135-287fbeac9944 tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 1061.198633] nova-scheduler[51959]: INFO nova.filters [None req-a4c7b854-69d7-4ec9-b135-287fbeac9944 tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Filter ComputeFilter returned 0 hosts [ 1061.198699] nova-scheduler[51959]: DEBUG nova.filters [None req-a4c7b854-69d7-4ec9-b135-287fbeac9944 tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Filtering removed all hosts for the request with instance ID '9cc5100d-3f93-4aac-8eb8-71776f8d765d'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 1061.198818] nova-scheduler[51959]: INFO nova.filters [None req-a4c7b854-69d7-4ec9-b135-287fbeac9944 tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Filtering removed all hosts for the request with instance ID '9cc5100d-3f93-4aac-8eb8-71776f8d765d'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 1061.198964] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-a4c7b854-69d7-4ec9-b135-287fbeac9944 tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1061.199203] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-a4c7b854-69d7-4ec9-b135-287fbeac9944 tempest-AttachInterfacesTestJSON-1338008180 tempest-AttachInterfacesTestJSON-1338008180-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 1064.402474] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-285a127f-efeb-407b-88b1-8d8daa088884 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Starting to schedule for instances: ['3ddae09d-0924-4332-a7ea-c81a56bc6d95'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1064.403217] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-285a127f-efeb-407b-88b1-8d8daa088884 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1064.403217] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-285a127f-efeb-407b-88b1-8d8daa088884 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1064.403217] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-285a127f-efeb-407b-88b1-8d8daa088884 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1064.403391] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-285a127f-efeb-407b-88b1-8d8daa088884 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1064.403580] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-285a127f-efeb-407b-88b1-8d8daa088884 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1064.452312] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-285a127f-efeb-407b-88b1-8d8daa088884 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1064.452543] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-285a127f-efeb-407b-88b1-8d8daa088884 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1064.452711] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-285a127f-efeb-407b-88b1-8d8daa088884 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1064.459429] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-285a127f-efeb-407b-88b1-8d8daa088884 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1064.459661] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-285a127f-efeb-407b-88b1-8d8daa088884 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1064.460013] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-285a127f-efeb-407b-88b1-8d8daa088884 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='20',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_581c2db844984c00bc0bad0475272109='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='0',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_deleting='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:11:06Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=2) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1064.460295] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-285a127f-efeb-407b-88b1-8d8daa088884 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1064.460461] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-285a127f-efeb-407b-88b1-8d8daa088884 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 5, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 9, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 9, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1064.460647] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-285a127f-efeb-407b-88b1-8d8daa088884 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Update host state with instances: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1064.460769] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-285a127f-efeb-407b-88b1-8d8daa088884 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1064.461044] nova-scheduler[51961]: DEBUG nova.filters [None req-285a127f-efeb-407b-88b1-8d8daa088884 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1064.461262] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-285a127f-efeb-407b-88b1-8d8daa088884 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:09:25. Elapsed time is 110.323498 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 1064.461417] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-285a127f-efeb-407b-88b1-8d8daa088884 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 1064.461569] nova-scheduler[51961]: INFO nova.filters [None req-285a127f-efeb-407b-88b1-8d8daa088884 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Filter ComputeFilter returned 0 hosts [ 1064.461717] nova-scheduler[51961]: DEBUG nova.filters [None req-285a127f-efeb-407b-88b1-8d8daa088884 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Filtering removed all hosts for the request with instance ID '3ddae09d-0924-4332-a7ea-c81a56bc6d95'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 1064.461856] nova-scheduler[51961]: INFO nova.filters [None req-285a127f-efeb-407b-88b1-8d8daa088884 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Filtering removed all hosts for the request with instance ID '3ddae09d-0924-4332-a7ea-c81a56bc6d95'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 1064.462009] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-285a127f-efeb-407b-88b1-8d8daa088884 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1064.462162] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-285a127f-efeb-407b-88b1-8d8daa088884 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 1067.177046] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-628a086a-7dd0-4e0a-8b6e-2958e0218ab3 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Starting to schedule for instances: ['534e93b0-9048-4397-a5d5-5664f2ebf05d'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1067.177046] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-628a086a-7dd0-4e0a-8b6e-2958e0218ab3 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1067.180557] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-628a086a-7dd0-4e0a-8b6e-2958e0218ab3 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1067.180557] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-628a086a-7dd0-4e0a-8b6e-2958e0218ab3 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1067.180557] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-628a086a-7dd0-4e0a-8b6e-2958e0218ab3 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1067.180557] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-628a086a-7dd0-4e0a-8b6e-2958e0218ab3 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1067.229885] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-628a086a-7dd0-4e0a-8b6e-2958e0218ab3 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1067.230141] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-628a086a-7dd0-4e0a-8b6e-2958e0218ab3 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1067.230316] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-628a086a-7dd0-4e0a-8b6e-2958e0218ab3 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1067.237688] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-628a086a-7dd0-4e0a-8b6e-2958e0218ab3 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1067.237909] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-628a086a-7dd0-4e0a-8b6e-2958e0218ab3 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1067.238292] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-628a086a-7dd0-4e0a-8b6e-2958e0218ab3 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='20',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_581c2db844984c00bc0bad0475272109='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='0',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_deleting='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:11:06Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=2) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1067.238568] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-628a086a-7dd0-4e0a-8b6e-2958e0218ab3 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1067.238738] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-628a086a-7dd0-4e0a-8b6e-2958e0218ab3 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 5, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 9, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 9, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1067.238895] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-628a086a-7dd0-4e0a-8b6e-2958e0218ab3 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Update host state with instances: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1067.239072] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-628a086a-7dd0-4e0a-8b6e-2958e0218ab3 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1067.239330] nova-scheduler[51959]: DEBUG nova.filters [None req-628a086a-7dd0-4e0a-8b6e-2958e0218ab3 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1067.239534] nova-scheduler[51959]: DEBUG nova.servicegroup.drivers.db [None req-628a086a-7dd0-4e0a-8b6e-2958e0218ab3 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:09:25. Elapsed time is 113.101782 {{(pid=51959) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 1067.239691] nova-scheduler[51959]: WARNING nova.scheduler.filters.compute_filter [None req-628a086a-7dd0-4e0a-8b6e-2958e0218ab3 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 1067.239841] nova-scheduler[51959]: INFO nova.filters [None req-628a086a-7dd0-4e0a-8b6e-2958e0218ab3 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Filter ComputeFilter returned 0 hosts [ 1067.239989] nova-scheduler[51959]: DEBUG nova.filters [None req-628a086a-7dd0-4e0a-8b6e-2958e0218ab3 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Filtering removed all hosts for the request with instance ID '534e93b0-9048-4397-a5d5-5664f2ebf05d'. Filter results: [('ComputeFilter', None)] {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 1067.240143] nova-scheduler[51959]: INFO nova.filters [None req-628a086a-7dd0-4e0a-8b6e-2958e0218ab3 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Filtering removed all hosts for the request with instance ID '534e93b0-9048-4397-a5d5-5664f2ebf05d'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 1067.240286] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-628a086a-7dd0-4e0a-8b6e-2958e0218ab3 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] Filtered [] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1067.240431] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-628a086a-7dd0-4e0a-8b6e-2958e0218ab3 tempest-AttachVolumeShelveTestJSON-60207750 tempest-AttachVolumeShelveTestJSON-60207750-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51959) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 1068.010745] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-b4a2cf26-b4a6-45b1-9021-e363f20a3105 tempest-ServersV294TestFqdnHostnames-875455869 tempest-ServersV294TestFqdnHostnames-875455869-project-member] Starting to schedule for instances: ['52aae65b-6003-4692-a38a-63130b2a1151'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1068.011057] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-b4a2cf26-b4a6-45b1-9021-e363f20a3105 tempest-ServersV294TestFqdnHostnames-875455869 tempest-ServersV294TestFqdnHostnames-875455869-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1068.011582] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-b4a2cf26-b4a6-45b1-9021-e363f20a3105 tempest-ServersV294TestFqdnHostnames-875455869 tempest-ServersV294TestFqdnHostnames-875455869-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1068.011791] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-b4a2cf26-b4a6-45b1-9021-e363f20a3105 tempest-ServersV294TestFqdnHostnames-875455869 tempest-ServersV294TestFqdnHostnames-875455869-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1068.011995] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-b4a2cf26-b4a6-45b1-9021-e363f20a3105 tempest-ServersV294TestFqdnHostnames-875455869 tempest-ServersV294TestFqdnHostnames-875455869-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1068.012216] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-b4a2cf26-b4a6-45b1-9021-e363f20a3105 tempest-ServersV294TestFqdnHostnames-875455869 tempest-ServersV294TestFqdnHostnames-875455869-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1068.054589] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-b4a2cf26-b4a6-45b1-9021-e363f20a3105 tempest-ServersV294TestFqdnHostnames-875455869 tempest-ServersV294TestFqdnHostnames-875455869-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1068.054887] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-b4a2cf26-b4a6-45b1-9021-e363f20a3105 tempest-ServersV294TestFqdnHostnames-875455869 tempest-ServersV294TestFqdnHostnames-875455869-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1068.055110] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-b4a2cf26-b4a6-45b1-9021-e363f20a3105 tempest-ServersV294TestFqdnHostnames-875455869 tempest-ServersV294TestFqdnHostnames-875455869-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1068.062563] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-b4a2cf26-b4a6-45b1-9021-e363f20a3105 tempest-ServersV294TestFqdnHostnames-875455869 tempest-ServersV294TestFqdnHostnames-875455869-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1068.062782] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-b4a2cf26-b4a6-45b1-9021-e363f20a3105 tempest-ServersV294TestFqdnHostnames-875455869 tempest-ServersV294TestFqdnHostnames-875455869-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1068.063152] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-b4a2cf26-b4a6-45b1-9021-e363f20a3105 tempest-ServersV294TestFqdnHostnames-875455869 tempest-ServersV294TestFqdnHostnames-875455869-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='20',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_581c2db844984c00bc0bad0475272109='1',num_proj_c70189e619ac48ffaccbeb4f298abbe1='0',num_proj_eb70c075cb2e4c44917d5ba6cb849786='1',num_task_deleting='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:11:06Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=2) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1068.063431] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-b4a2cf26-b4a6-45b1-9021-e363f20a3105 tempest-ServersV294TestFqdnHostnames-875455869 tempest-ServersV294TestFqdnHostnames-875455869-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1068.063598] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-b4a2cf26-b4a6-45b1-9021-e363f20a3105 tempest-ServersV294TestFqdnHostnames-875455869 tempest-ServersV294TestFqdnHostnames-875455869-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 5, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 9, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 9, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1068.063819] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-b4a2cf26-b4a6-45b1-9021-e363f20a3105 tempest-ServersV294TestFqdnHostnames-875455869 tempest-ServersV294TestFqdnHostnames-875455869-project-member] Update host state with instances: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1068.064200] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-b4a2cf26-b4a6-45b1-9021-e363f20a3105 tempest-ServersV294TestFqdnHostnames-875455869 tempest-ServersV294TestFqdnHostnames-875455869-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1068.064325] nova-scheduler[51961]: DEBUG nova.filters [None req-b4a2cf26-b4a6-45b1-9021-e363f20a3105 tempest-ServersV294TestFqdnHostnames-875455869 tempest-ServersV294TestFqdnHostnames-875455869-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1068.064876] nova-scheduler[51961]: DEBUG nova.servicegroup.drivers.db [None req-b4a2cf26-b4a6-45b1-9021-e363f20a3105 tempest-ServersV294TestFqdnHostnames-875455869 tempest-ServersV294TestFqdnHostnames-875455869-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2025-02-03 11:09:25. Elapsed time is 113.926713 {{(pid=51961) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 1068.064876] nova-scheduler[51961]: WARNING nova.scheduler.filters.compute_filter [None req-b4a2cf26-b4a6-45b1-9021-e363f20a3105 tempest-ServersV294TestFqdnHostnames-875455869 tempest-ServersV294TestFqdnHostnames-875455869-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 1068.064876] nova-scheduler[51961]: INFO nova.filters [None req-b4a2cf26-b4a6-45b1-9021-e363f20a3105 tempest-ServersV294TestFqdnHostnames-875455869 tempest-ServersV294TestFqdnHostnames-875455869-project-member] Filter ComputeFilter returned 0 hosts [ 1068.064876] nova-scheduler[51961]: DEBUG nova.filters [None req-b4a2cf26-b4a6-45b1-9021-e363f20a3105 tempest-ServersV294TestFqdnHostnames-875455869 tempest-ServersV294TestFqdnHostnames-875455869-project-member] Filtering removed all hosts for the request with instance ID '52aae65b-6003-4692-a38a-63130b2a1151'. Filter results: [('ComputeFilter', None)] {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 1068.065170] nova-scheduler[51961]: INFO nova.filters [None req-b4a2cf26-b4a6-45b1-9021-e363f20a3105 tempest-ServersV294TestFqdnHostnames-875455869 tempest-ServersV294TestFqdnHostnames-875455869-project-member] Filtering removed all hosts for the request with instance ID '52aae65b-6003-4692-a38a-63130b2a1151'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 1068.065170] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-b4a2cf26-b4a6-45b1-9021-e363f20a3105 tempest-ServersV294TestFqdnHostnames-875455869 tempest-ServersV294TestFqdnHostnames-875455869-project-member] Filtered [] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1068.065309] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-b4a2cf26-b4a6-45b1-9021-e363f20a3105 tempest-ServersV294TestFqdnHostnames-875455869 tempest-ServersV294TestFqdnHostnames-875455869-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51961) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 1073.026744] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b90d5fb7-43a1-4404-be68-2bea0c80b8d3 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1073.027008] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b90d5fb7-43a1-4404-be68-2bea0c80b8d3 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1073.027222] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-b90d5fb7-43a1-4404-be68-2bea0c80b8d3 None None] Successfully synced instances from host 'cpu-1'. {{(pid=51959) sync_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:972}} [ 1073.027391] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-b90d5fb7-43a1-4404-be68-2bea0c80b8d3 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1073.029976] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-b90d5fb7-43a1-4404-be68-2bea0c80b8d3 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1073.030269] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-b90d5fb7-43a1-4404-be68-2bea0c80b8d3 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1073.030441] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-b90d5fb7-43a1-4404-be68-2bea0c80b8d3 None None] Successfully synced instances from host 'cpu-1'. {{(pid=51961) sync_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:972}} [ 1073.030602] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-b90d5fb7-43a1-4404-be68-2bea0c80b8d3 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1074.367573] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Starting to schedule for instances: ['4754c01f-d312-4b2a-af5a-a34c5bcb42eb'] {{(pid=51959) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1074.367573] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51959) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1074.367928] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1074.367928] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1074.368299] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51959) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1074.368299] nova-scheduler[51959]: DEBUG nova.scheduler.request_filter [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] ephemeral_encryption_filter skipped {{(pid=51959) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1074.408338] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1074.408569] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1074.408738] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1074.415226] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1074.415913] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1074.415913] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='26'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:11:25Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=0) {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1074.416170] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Update host state with aggregates: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1074.416226] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 6, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 11, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 11, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1074.416382] nova-scheduler[51959]: DEBUG nova.scheduler.host_manager [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Update host state with instances: [] {{(pid=51959) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1074.417029] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1074.417029] nova-scheduler[51959]: DEBUG nova.filters [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Starting with 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1074.417029] nova-scheduler[51959]: DEBUG nova.filters [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1074.417242] nova-scheduler[51959]: DEBUG nova.filters [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1074.417404] nova-scheduler[51959]: DEBUG nova.filters [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1074.417587] nova-scheduler[51959]: DEBUG nova.filters [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1074.417749] nova-scheduler[51959]: DEBUG nova.filters [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1074.417920] nova-scheduler[51959]: DEBUG nova.filters [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1074.418097] nova-scheduler[51959]: DEBUG nova.filters [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51959) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1074.418256] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1074.418431] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1, weight: 0.0]] {{(pid=51959) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 1074.418604] nova-scheduler[51959]: DEBUG nova.scheduler.utils [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Attempting to claim resources in the placement API for instance 4754c01f-d312-4b2a-af5a-a34c5bcb42eb {{(pid=51959) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 1074.468527] nova-scheduler[51959]: DEBUG nova.scheduler.manager [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] [instance: 4754c01f-d312-4b2a-af5a-a34c5bcb42eb] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 {{(pid=51959) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 1074.471199] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1074.471480] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.003s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1074.471717] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-e3b90cce-9493-4211-a984-92014de3d208 tempest-ServerAddressesNegativeTestJSON-2061325312 tempest-ServerAddressesNegativeTestJSON-2061325312-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1196.028373] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-75d16cd9-5f94-49cb-b9f6-8eeff175c35a None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1196.028651] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-75d16cd9-5f94-49cb-b9f6-8eeff175c35a None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1196.028903] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-75d16cd9-5f94-49cb-b9f6-8eeff175c35a None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1196.029231] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-75d16cd9-5f94-49cb-b9f6-8eeff175c35a None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1196.029316] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-75d16cd9-5f94-49cb-b9f6-8eeff175c35a None None] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1196.029489] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-75d16cd9-5f94-49cb-b9f6-8eeff175c35a None None] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1196.030479] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-75d16cd9-5f94-49cb-b9f6-8eeff175c35a None None] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1196.030871] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-75d16cd9-5f94-49cb-b9f6-8eeff175c35a None None] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1196.030957] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-75d16cd9-5f94-49cb-b9f6-8eeff175c35a None None] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1196.030997] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-75d16cd9-5f94-49cb-b9f6-8eeff175c35a None None] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1196.032793] nova-scheduler[51959]: INFO nova.scheduler.host_manager [None req-75d16cd9-5f94-49cb-b9f6-8eeff175c35a None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 1196.033015] nova-scheduler[51959]: DEBUG oslo_concurrency.lockutils [None req-75d16cd9-5f94-49cb-b9f6-8eeff175c35a None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.004s {{(pid=51959) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1196.033207] nova-scheduler[51961]: INFO nova.scheduler.host_manager [None req-75d16cd9-5f94-49cb-b9f6-8eeff175c35a None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 1196.033425] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-75d16cd9-5f94-49cb-b9f6-8eeff175c35a None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.005s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1206.512560] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Starting to schedule for instances: ['2d7dbbc6-07b5-4f4c-8098-d190fabc545b'] {{(pid=51961) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1206.512876] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51961) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1206.513067] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1206.513262] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1206.513466] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51961) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1206.513647] nova-scheduler[51961]: DEBUG nova.scheduler.request_filter [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] ephemeral_encryption_filter skipped {{(pid=51961) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1206.609646] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1206.609942] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1206.610168] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1206.617081] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Acquiring lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1206.617285] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1206.617449] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Lock "e9ed2ce3-0d39-42ad-aaef-fb9d005eeabe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1206.619565] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1206.619765] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1206.620126] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2025-02-03T11:01:19Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='30',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_583d131351dd4ef6a6db6ffd061a6a1e='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2025-02-03T11:13:31Z,uuid=f00c8c1a-f294-46ac-89cc-95e9e57a7dca,vcpus=48,vcpus_used=0) {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1206.620462] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Update host state with aggregates: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1206.620665] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Update host state with service dict: {'id': 8, 'uuid': '946812bb-dd3e-43cd-86db-c9e063a7d644', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 7, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2025, 2, 3, 11, 13, 25, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2025, 2, 3, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 2, 3, 11, 13, 25, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1206.620784] nova-scheduler[51961]: DEBUG nova.scheduler.host_manager [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Update host state with instances: [] {{(pid=51961) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1206.620978] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1206.621313] nova-scheduler[51961]: DEBUG nova.filters [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Starting with 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1206.621524] nova-scheduler[51961]: DEBUG nova.filters [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1206.621706] nova-scheduler[51961]: DEBUG nova.filters [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1206.621926] nova-scheduler[51961]: DEBUG nova.filters [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1206.622141] nova-scheduler[51961]: DEBUG nova.filters [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1206.622320] nova-scheduler[51961]: DEBUG nova.filters [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1206.622499] nova-scheduler[51961]: DEBUG nova.filters [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1206.622664] nova-scheduler[51961]: DEBUG nova.filters [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51961) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1206.622821] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1206.622992] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1, weight: 0.0]] {{(pid=51961) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 1206.623188] nova-scheduler[51961]: DEBUG nova.scheduler.utils [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Attempting to claim resources in the placement API for instance 2d7dbbc6-07b5-4f4c-8098-d190fabc545b {{(pid=51961) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 1206.674874] nova-scheduler[51961]: DEBUG nova.scheduler.manager [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] [instance: 2d7dbbc6-07b5-4f4c-8098-d190fabc545b] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 {{(pid=51961) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 1206.676024] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1206.676024] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1206.676024] nova-scheduler[51961]: DEBUG oslo_concurrency.lockutils [None req-b1b1b82c-5b1e-4d27-b73d-ae9ccb92cc5c tempest-ServerRescueTestJSONUnderV235-24253888 tempest-ServerRescueTestJSONUnderV235-24253888-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51961) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}