[ 418.868578] nova-conductor[52581]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. [ 420.125626] nova-conductor[52581]: DEBUG oslo_db.sqlalchemy.engines [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=52581) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 420.153511] nova-conductor[52581]: DEBUG nova.context [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),09b9d109-a207-40de-96b0-5d124568ab99(cell1) {{(pid=52581) load_cells /opt/stack/nova/nova/context.py:464}} [ 420.155359] nova-conductor[52581]: DEBUG oslo_concurrency.lockutils [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52581) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 420.155583] nova-conductor[52581]: DEBUG oslo_concurrency.lockutils [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52581) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 420.156058] nova-conductor[52581]: DEBUG oslo_concurrency.lockutils [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52581) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 420.156413] nova-conductor[52581]: DEBUG oslo_concurrency.lockutils [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52581) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 420.156595] nova-conductor[52581]: DEBUG oslo_concurrency.lockutils [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52581) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 420.157540] nova-conductor[52581]: DEBUG oslo_concurrency.lockutils [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=52581) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 420.162996] nova-conductor[52581]: DEBUG oslo_db.sqlalchemy.engines [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=52581) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 420.163437] nova-conductor[52581]: DEBUG oslo_db.sqlalchemy.engines [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=52581) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 420.227203] nova-conductor[52581]: DEBUG oslo_concurrency.lockutils [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] Acquiring lock "singleton_lock" {{(pid=52581) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} [ 420.227383] nova-conductor[52581]: DEBUG oslo_concurrency.lockutils [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] Acquired lock "singleton_lock" {{(pid=52581) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} [ 420.227647] nova-conductor[52581]: DEBUG oslo_concurrency.lockutils [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] Releasing lock "singleton_lock" {{(pid=52581) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} [ 420.228061] nova-conductor[52581]: INFO oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] Starting 2 workers [ 420.232420] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] Started child 53001 {{(pid=52581) _start_child /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:575}} [ 420.236830] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] Started child 53002 {{(pid=52581) _start_child /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:575}} [ 420.237289] nova-conductor[53001]: INFO nova.service [-] Starting conductor node (version 0.0.1) [ 420.237515] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] Full set of CONF: {{(pid=52581) wait /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:649}} [ 420.237660] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ******************************************************************************** {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} [ 420.237822] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] Configuration options gathered from: {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} [ 420.237970] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} [ 420.238342] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] config files: ['/etc/nova/nova.conf'] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} [ 420.238495] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ================================================================================ {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} [ 420.238900] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] allow_resize_to_same_host = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.239127] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] arq_binding_timeout = 300 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.239332] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] block_device_allocate_retries = 60 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.239525] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] block_device_allocate_retries_interval = 3 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.239874] nova-conductor[53002]: INFO nova.service [-] Starting conductor node (version 0.0.1) [ 420.240074] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cert = self.pem {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.240297] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] compute_driver = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.240571] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] compute_monitors = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.240852] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] config_dir = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.241085] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] config_drive_format = iso9660 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.241242] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] config_file = ['/etc/nova/nova.conf'] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.241520] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] config_source = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.241735] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] console_host = devstack {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.241944] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] control_exchange = nova {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.242149] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cpu_allocation_ratio = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.242336] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] daemon = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.242601] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] debug = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.242780] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] default_access_ip_network_name = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.242985] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] default_availability_zone = nova {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.243182] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] default_ephemeral_format = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.243472] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.243660] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] default_schedule_zone = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.243823] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] disk_allocation_ratio = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.243996] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] enable_new_services = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.244260] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] enabled_apis = ['osapi_compute'] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.244443] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] enabled_ssl_apis = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.244659] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] flat_injected = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.244806] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] force_config_drive = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.244962] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] force_raw_images = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.245151] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] graceful_shutdown_timeout = 5 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.245310] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] heal_instance_info_cache_interval = 60 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.245707] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] host = devstack {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.245887] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] initial_cpu_allocation_ratio = 4.0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.246071] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] initial_disk_allocation_ratio = 1.0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.246232] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] initial_ram_allocation_ratio = 1.0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.246483] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.246685] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] instance_build_timeout = 0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.246825] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] instance_delete_interval = 300 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.246991] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] instance_format = [instance: %(uuid)s] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.247165] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] instance_name_template = instance-%08x {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.247346] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] instance_usage_audit = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.247541] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] instance_usage_audit_period = month {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.247706] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.247957] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] instances_path = /opt/stack/data/nova/instances {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.248076] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] internal_service_availability_zone = internal {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.248234] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] key = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.248383] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] live_migration_retry_count = 30 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.248569] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] log_config_append = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.248729] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.248880] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] log_dir = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.249039] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] log_file = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.249165] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] log_options = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.249321] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] log_rotate_interval = 1 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.249527] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] log_rotate_interval_type = days {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.249731] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] log_rotation_type = none {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.250138] nova-conductor[53001]: DEBUG oslo_db.sqlalchemy.engines [None req-15742cb7-b265-44af-a6b8-06b61615ff11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=53001) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 420.250527] nova-conductor[53002]: DEBUG oslo_db.sqlalchemy.engines [None req-d2c30ec2-90e2-4726-a38a-882f280dd693 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=53002) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 420.250693] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.250850] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.251118] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.251327] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.251481] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.251683] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] long_rpc_timeout = 1800 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.251840] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] max_concurrent_builds = 10 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.252021] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] max_concurrent_live_migrations = 1 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.252180] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] max_concurrent_snapshots = 5 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.252357] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] max_local_block_devices = 3 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.252522] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] max_logfile_count = 30 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.252679] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] max_logfile_size_mb = 200 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.252831] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] maximum_instance_delete_attempts = 5 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.252998] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] metadata_listen = 0.0.0.0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.253240] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] metadata_listen_port = 8775 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.253430] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] metadata_workers = 2 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.253588] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] migrate_max_retries = -1 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.253766] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] mkisofs_cmd = genisoimage {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.253970] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] my_block_storage_ip = 10.180.1.21 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.254111] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] my_ip = 10.180.1.21 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.254272] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] network_allocate_retries = 0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.254466] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.254636] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] osapi_compute_listen = 0.0.0.0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.254792] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] osapi_compute_listen_port = 8774 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.254953] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] osapi_compute_unique_server_name_scope = {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.255125] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] osapi_compute_workers = 2 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.255303] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] password_length = 12 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.255479] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] periodic_enable = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.255633] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] periodic_fuzzy_delay = 60 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.255810] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] pointer_model = usbtablet {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.255992] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] preallocate_images = none {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.256163] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] publish_errors = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.256289] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] pybasedir = /opt/stack/nova {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.256441] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ram_allocation_ratio = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.256624] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] rate_limit_burst = 0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.256785] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] rate_limit_except_level = CRITICAL {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.256940] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] rate_limit_interval = 0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.257124] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] reboot_timeout = 0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.257295] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] reclaim_instance_interval = 0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.257449] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] record = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.257610] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] reimage_timeout_per_gb = 20 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.257827] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] report_interval = 10 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.257996] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] rescue_timeout = 0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.258170] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] reserved_host_cpus = 0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.258317] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] reserved_host_disk_mb = 0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.258469] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] reserved_host_memory_mb = 512 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.258627] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] reserved_huge_pages = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.258782] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] resize_confirm_window = 0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.258933] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] resize_fs_using_block_device = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.259094] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] resume_guests_state_on_host_boot = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.259276] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.259441] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] rpc_response_timeout = 60 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.259595] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] run_external_periodic_tasks = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.259780] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] running_deleted_instance_action = reap {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.259950] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] running_deleted_instance_poll_interval = 1800 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.260120] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] running_deleted_instance_timeout = 0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.260297] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] scheduler_instance_sync_interval = 120 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.260478] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] service_down_time = 60 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.260665] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] servicegroup_driver = db {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.260818] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] shelved_offload_time = 0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.260972] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] shelved_poll_interval = 3600 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.261152] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] shutdown_timeout = 0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.261311] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] source_is_ipv6 = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.261470] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ssl_only = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.261634] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] state_path = /opt/stack/data/nova {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.261787] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] sync_power_state_interval = 600 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.261960] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] sync_power_state_pool_size = 1000 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.262141] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] syslog_log_facility = LOG_USER {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.262303] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] tempdir = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.262487] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] timeout_nbd = 10 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.262650] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] transport_url = **** {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.262825] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] update_resources_interval = 0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.262984] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] use_cow_images = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.263153] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] use_eventlog = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.263357] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] use_journal = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.263537] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] use_json = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.263702] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] use_rootwrap_daemon = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.263858] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] use_stderr = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.264022] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] use_syslog = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.264176] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vcpu_pin_set = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.264345] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vif_plugging_is_fatal = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.264512] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vif_plugging_timeout = 300 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.264709] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] virt_mkfs = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.264865] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] volume_usage_poll_interval = 0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.265320] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] watch_log_file = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.265320] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] web = /usr/share/spice-html5 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 420.265486] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_concurrency.disable_process_locking = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.265686] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.265884] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.266065] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.266236] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.266403] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.266565] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.266794] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api.auth_strategy = keystone {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.266981] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api.compute_link_prefix = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.267196] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.267372] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api.dhcp_domain = novalocal {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.267540] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api.enable_instance_password = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.267703] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api.glance_link_prefix = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.267859] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.268053] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.268320] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api.instance_list_per_project_cells = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.268364] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api.list_records_by_skipping_down_cells = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.268524] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api.local_metadata_per_cell = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.268706] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api.max_limit = 1000 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.268870] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api.metadata_cache_expiration = 15 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.269047] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api.neutron_default_tenant_id = default {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.269238] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api.use_forwarded_for = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.269399] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api.use_neutron_default_nets = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.269566] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.269722] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.269884] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.270066] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api.vendordata_dynamic_ssl_certfile = {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.270256] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api.vendordata_dynamic_targets = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.270433] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api.vendordata_jsonfile_path = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.270639] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api.vendordata_providers = ['StaticJSON'] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.270891] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.backend = dogpile.cache.memcached {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.271066] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.backend_argument = **** {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.271256] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.config_prefix = cache.oslo {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.271454] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.dead_timeout = 60.0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.271639] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.debug_cache_backend = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.271823] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.enable_retry_client = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.271980] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.enable_socket_keepalive = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.272161] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.enabled = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.272362] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.expiration_time = 600 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.272543] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.hashclient_retry_attempts = 2 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.272709] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.hashclient_retry_delay = 1.0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.272956] nova-conductor[53001]: DEBUG nova.service [None req-15742cb7-b265-44af-a6b8-06b61615ff11 None None] Creating RPC server for service conductor {{(pid=53001) start /opt/stack/nova/nova/service.py:182}} [ 420.273124] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.memcache_dead_retry = 300 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.273313] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.memcache_password = {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.273562] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.273827] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.274105] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.memcache_pool_maxsize = 10 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.274368] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.274640] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.memcache_sasl_enabled = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.274920] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.275200] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.memcache_socket_timeout = 1.0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.275392] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.memcache_username = {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.275590] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.proxies = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.275770] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.retry_attempts = 2 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.275940] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.retry_delay = 0.0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.276156] nova-conductor[53002]: DEBUG nova.service [None req-d2c30ec2-90e2-4726-a38a-882f280dd693 None None] Creating RPC server for service conductor {{(pid=53002) start /opt/stack/nova/nova/service.py:182}} [ 420.276301] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.socket_keepalive_count = 1 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.276481] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.socket_keepalive_idle = 1 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.276639] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.socket_keepalive_interval = 1 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.276796] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.tls_allowed_ciphers = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.276948] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.tls_cafile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.277120] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.tls_certfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.277278] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.tls_enabled = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.277427] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cache.tls_keyfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.277633] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cinder.auth_section = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.277832] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cinder.auth_type = password {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.277993] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cinder.cafile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.278196] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cinder.catalog_info = volumev3::publicURL {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.278374] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cinder.certfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.278564] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cinder.collect_timing = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.278751] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cinder.cross_az_attach = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.278933] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cinder.debug = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.279101] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cinder.endpoint_template = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.279283] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cinder.http_retries = 3 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.279446] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cinder.insecure = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.279599] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cinder.keyfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.279784] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cinder.os_region_name = RegionOne {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.279945] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cinder.split_loggers = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.280110] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cinder.timeout = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.280277] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.280433] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] compute.cpu_dedicated_set = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.280591] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] compute.cpu_shared_set = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.280755] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] compute.image_type_exclude_list = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.280912] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.281077] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] compute.max_concurrent_disk_ops = 0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.281233] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] compute.max_disk_devices_to_attach = -1 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.281394] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.281560] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.281719] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] compute.resource_provider_association_refresh = 300 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.281897] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] compute.shutdown_retry_interval = 10 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.282082] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.282256] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] conductor.workers = 2 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.282463] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] console.allowed_origins = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.282778] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] console.ssl_ciphers = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.282846] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] console.ssl_minimum_version = default {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.282972] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] consoleauth.token_ttl = 600 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.283176] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cyborg.cafile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.283356] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cyborg.certfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.283520] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cyborg.collect_timing = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.283677] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cyborg.connect_retries = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.283851] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cyborg.connect_retry_delay = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.284042] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cyborg.endpoint_override = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.284207] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cyborg.insecure = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.284358] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cyborg.keyfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.284540] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cyborg.max_version = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.284702] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cyborg.min_version = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.284847] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cyborg.region_name = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.284998] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cyborg.service_name = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.285180] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cyborg.service_type = accelerator {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.285336] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cyborg.split_loggers = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.285526] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cyborg.status_code_retries = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.285697] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cyborg.status_code_retry_delay = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.285853] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cyborg.timeout = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.286641] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.286641] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] cyborg.version = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.286641] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] database.backend = sqlalchemy {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.286641] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] database.connection = **** {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.286789] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] database.connection_debug = 0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.286876] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] database.connection_parameters = {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.287028] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] database.connection_recycle_time = 3600 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.287184] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] database.connection_trace = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.287343] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] database.db_inc_retry_interval = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.287507] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] database.db_max_retries = 20 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.287660] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] database.db_max_retry_interval = 10 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.287815] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] database.db_retry_interval = 1 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.287975] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] database.max_overflow = 50 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.288167] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] database.max_pool_size = 5 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.288291] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] database.max_retries = 10 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.288454] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] database.mysql_enable_ndb = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.288683] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.288841] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] database.mysql_wsrep_sync_wait = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.289267] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] database.pool_timeout = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.289267] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] database.retry_interval = 10 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.289386] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] database.slave_connection = **** {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.289519] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] database.sqlite_synchronous = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.289861] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] database.use_db_reconnect = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.289861] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api_database.backend = sqlalchemy {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.289964] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api_database.connection = **** {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.290415] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api_database.connection_debug = 0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.290415] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api_database.connection_parameters = {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.290503] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api_database.connection_recycle_time = 3600 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.290600] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api_database.connection_trace = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.290750] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api_database.db_inc_retry_interval = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.290904] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api_database.db_max_retries = 20 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.291065] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api_database.db_max_retry_interval = 10 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.291222] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api_database.db_retry_interval = 1 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.291390] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api_database.max_overflow = 50 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.291645] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api_database.max_pool_size = 5 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.291752] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api_database.max_retries = 10 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.291944] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api_database.mysql_enable_ndb = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.292043] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.292176] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.292696] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api_database.pool_timeout = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.292696] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api_database.retry_interval = 10 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.292696] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api_database.slave_connection = **** {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.292825] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] api_database.sqlite_synchronous = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.292987] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] devices.enabled_mdev_types = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.293197] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.293375] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ephemeral_storage_encryption.enabled = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.293523] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.293730] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.api_servers = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.293959] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.cafile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.294036] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.certfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.294313] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.collect_timing = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.294389] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.connect_retries = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.294505] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.connect_retry_delay = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.294666] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.debug = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.294872] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.default_trusted_certificate_ids = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.295052] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.enable_certificate_validation = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.295544] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.enable_rbd_download = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.295544] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.endpoint_override = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.295544] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.insecure = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.295690] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.keyfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.295850] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.max_version = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.296014] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.min_version = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.296175] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.num_retries = 3 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.296639] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.rbd_ceph_conf = {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.296639] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.rbd_connect_timeout = 5 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.296639] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.rbd_pool = {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.296781] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.rbd_user = {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.296932] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.region_name = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.297104] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.service_name = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.297266] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.service_type = image {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.297480] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.split_loggers = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.297580] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.status_code_retries = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.297734] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.status_code_retry_delay = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.298381] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.timeout = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.298381] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.298381] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.verify_glance_signatures = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.298381] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] glance.version = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.298531] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] guestfs.debug = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.298760] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] hyperv.config_drive_cdrom = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.298925] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] hyperv.config_drive_inject_password = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.299163] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.299373] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] hyperv.enable_instance_metrics_collection = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.299473] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] hyperv.enable_remotefx = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.299561] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] hyperv.instances_path_share = {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.299775] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] hyperv.iscsi_initiator_list = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.299868] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] hyperv.limit_cpu_features = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.300026] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.300275] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.300392] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] hyperv.power_state_check_timeframe = 60 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.300598] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.300772] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.300933] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] hyperv.use_multipath_io = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.301104] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] hyperv.volume_attach_retry_count = 10 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.301353] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.301446] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] hyperv.vswitch_name = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.301628] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.301830] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] mks.enabled = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.303164] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.303164] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] image_cache.manager_interval = 2400 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.303164] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] image_cache.precache_concurrency = 1 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.303164] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] image_cache.remove_unused_base_images = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.303164] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.303378] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.303817] nova-conductor[53001]: DEBUG nova.service [None req-15742cb7-b265-44af-a6b8-06b61615ff11 None None] Join ServiceGroup membership for this service conductor {{(pid=53001) start /opt/stack/nova/nova/service.py:199}} [ 420.303975] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] image_cache.subdirectory_name = _base {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.304215] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ironic.api_max_retries = 60 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.304528] nova-conductor[53001]: DEBUG nova.servicegroup.drivers.db [None req-15742cb7-b265-44af-a6b8-06b61615ff11 None None] DB_Driver: join new ServiceGroup member devstack to the conductor group, service = {{(pid=53001) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} [ 420.304587] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ironic.api_retry_interval = 2 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.304805] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ironic.auth_section = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.305020] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ironic.auth_type = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.305187] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ironic.cafile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.305342] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ironic.certfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.305520] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ironic.collect_timing = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.305678] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ironic.connect_retries = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.305829] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ironic.connect_retry_delay = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.305985] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ironic.endpoint_override = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.306341] nova-conductor[53002]: DEBUG nova.service [None req-d2c30ec2-90e2-4726-a38a-882f280dd693 None None] Join ServiceGroup membership for this service conductor {{(pid=53002) start /opt/stack/nova/nova/service.py:199}} [ 420.306501] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ironic.insecure = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.306714] nova-conductor[53002]: DEBUG nova.servicegroup.drivers.db [None req-d2c30ec2-90e2-4726-a38a-882f280dd693 None None] DB_Driver: join new ServiceGroup member devstack to the conductor group, service = {{(pid=53002) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} [ 420.306854] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ironic.keyfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.307040] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ironic.max_version = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.307219] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ironic.min_version = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.307359] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ironic.partition_key = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.307523] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ironic.peer_list = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.307704] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ironic.region_name = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.307946] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ironic.serial_console_state_timeout = 10 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.308135] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ironic.service_name = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.308326] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ironic.service_type = baremetal {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.308487] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ironic.split_loggers = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.308644] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ironic.status_code_retries = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.308795] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ironic.status_code_retry_delay = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.308947] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ironic.timeout = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.309138] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.309319] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ironic.version = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.309554] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.309744] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] key_manager.fixed_key = **** {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.309958] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.310145] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] barbican.barbican_api_version = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.310309] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] barbican.barbican_endpoint = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.310498] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] barbican.barbican_endpoint_type = public {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.310679] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] barbican.barbican_region_name = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.310871] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] barbican.cafile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.311038] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] barbican.certfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.311199] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] barbican.collect_timing = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.311354] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] barbican.insecure = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.311507] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] barbican.keyfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.311688] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] barbican.number_of_retries = 60 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.311846] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] barbican.retry_delay = 1 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.312032] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] barbican.send_service_user_token = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.312193] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] barbican.split_loggers = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.312366] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] barbican.timeout = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.312529] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] barbican.verify_ssl = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.312681] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] barbican.verify_ssl_path = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.312863] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] barbican_service_user.auth_section = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.313030] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] barbican_service_user.auth_type = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.313184] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] barbican_service_user.cafile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.313358] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] barbican_service_user.certfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.313550] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] barbican_service_user.collect_timing = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.313712] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] barbican_service_user.insecure = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.313863] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] barbican_service_user.keyfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.314027] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] barbican_service_user.split_loggers = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.314186] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] barbican_service_user.timeout = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.314377] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vault.approle_role_id = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.314535] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vault.approle_secret_id = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.314688] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vault.cafile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.314854] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vault.certfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.315025] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vault.collect_timing = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.315183] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vault.insecure = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.315338] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vault.keyfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.315519] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vault.kv_mountpoint = secret {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.315681] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vault.kv_version = 2 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.315852] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vault.namespace = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.316013] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vault.root_token_id = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.316178] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vault.split_loggers = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.316333] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vault.ssl_ca_crt_file = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.316514] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vault.timeout = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.316676] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vault.use_ssl = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.316859] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.317060] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] keystone.cafile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.317237] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] keystone.certfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.317393] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] keystone.collect_timing = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.317546] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] keystone.connect_retries = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.317696] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] keystone.connect_retry_delay = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.317869] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] keystone.endpoint_override = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.318034] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] keystone.insecure = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.318188] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] keystone.keyfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.318340] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] keystone.max_version = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.318487] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] keystone.min_version = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.318638] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] keystone.region_name = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.318786] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] keystone.service_name = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.318945] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] keystone.service_type = identity {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.319110] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] keystone.split_loggers = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.319264] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] keystone.status_code_retries = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.319433] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] keystone.status_code_retry_delay = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.319617] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] keystone.timeout = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.319802] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.319956] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] keystone.version = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.320219] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.connection_uri = {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.320424] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.cpu_mode = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.320560] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.cpu_model_extra_flags = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.320723] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.cpu_models = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.320891] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.cpu_power_governor_high = performance {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.321065] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.cpu_power_governor_low = powersave {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.321230] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.cpu_power_management = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.321419] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.321592] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.device_detach_attempts = 8 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.321747] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.device_detach_timeout = 20 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.321904] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.disk_cachemodes = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.322068] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.disk_prefix = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.322234] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.enabled_perf_events = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.322430] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.file_backed_memory = 0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.322619] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.gid_maps = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.322827] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.hw_disk_discard = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.322988] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.hw_machine_type = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.323172] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.images_rbd_ceph_conf = {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.323334] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.323494] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.323658] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.images_rbd_glance_store_name = {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.323818] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.images_rbd_pool = rbd {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.323980] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.images_type = default {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.324147] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.images_volume_group = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.324311] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.inject_key = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.324469] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.inject_partition = -2 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.324627] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.inject_password = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.324781] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.iscsi_iface = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.324958] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.iser_use_multipath = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.325129] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.live_migration_bandwidth = 0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.325286] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.325467] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.live_migration_downtime = 500 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.325682] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.325850] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.326023] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.live_migration_inbound_addr = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.326181] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.326337] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.live_migration_permit_post_copy = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.326494] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.live_migration_scheme = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.326665] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.live_migration_timeout_action = abort {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.326820] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.live_migration_tunnelled = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.326976] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.live_migration_uri = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.327147] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.live_migration_with_native_tls = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.327324] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.max_queues = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.327485] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.327658] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.nfs_mount_options = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.328021] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.328205] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.328371] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.num_iser_scan_tries = 5 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.328552] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.num_memory_encrypted_guests = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.328724] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.328888] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.num_pcie_ports = 0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.329061] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.num_volume_scan_tries = 5 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.329275] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.pmem_namespaces = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.329433] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.quobyte_client_cfg = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.329657] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.329819] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.rbd_connect_timeout = 5 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.329976] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.330146] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.330308] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.rbd_secret_uuid = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.330458] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.rbd_user = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.330615] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.330834] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.remote_filesystem_transport = ssh {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.330994] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.rescue_image_id = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.331161] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.rescue_kernel_id = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.331313] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.rescue_ramdisk_id = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.331481] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.rng_dev_path = /dev/urandom {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.331675] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.rx_queue_size = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.331844] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.smbfs_mount_options = {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.332074] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.332241] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.snapshot_compression = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.332450] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.snapshot_image_format = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.332668] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.332828] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.sparse_logical_volumes = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.332985] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.swtpm_enabled = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.333160] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.swtpm_group = tss {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.333323] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.swtpm_user = tss {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.333483] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.sysinfo_serial = unique {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.333634] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.tx_queue_size = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.333836] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.uid_maps = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.334070] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.use_virtio_for_bridges = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.334252] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.virt_type = kvm {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.334416] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.volume_clear = zero {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.334601] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.volume_clear_size = 0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.334773] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.volume_use_multipath = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.334927] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.vzstorage_cache_path = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.335107] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.335271] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.vzstorage_mount_group = qemu {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.335436] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.vzstorage_mount_opts = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.335598] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.335813] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.335993] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.vzstorage_mount_user = stack {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.336221] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.336486] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.auth_section = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.336609] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.auth_type = password {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.336770] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.cafile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.336924] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.certfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.337095] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.collect_timing = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.337275] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.connect_retries = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.337430] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.connect_retry_delay = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.337640] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.default_floating_pool = public {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.337809] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.endpoint_override = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.337974] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.extension_sync_interval = 600 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.338143] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.http_retries = 3 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.338300] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.insecure = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.338456] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.keyfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.338610] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.max_version = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.338776] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.338930] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.min_version = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.339106] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.ovs_bridge = br-int {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.339270] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.physnets = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.339434] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.region_name = RegionOne {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.339596] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.service_metadata_proxy = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.339748] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.service_name = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.339911] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.service_type = network {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.340078] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.split_loggers = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.340239] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.status_code_retries = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.340391] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.status_code_retry_delay = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.340552] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.timeout = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.340751] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.340925] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] neutron.version = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.341124] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] notifications.bdms_in_notifications = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.341303] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] notifications.default_level = INFO {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.341478] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] notifications.notification_format = unversioned {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.341639] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] notifications.notify_on_state_change = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.341807] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.342007] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] pci.alias = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.342181] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] pci.device_spec = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.342362] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] pci.report_in_placement = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.342575] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.auth_section = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.342752] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.auth_type = password {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.342921] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.auth_url = http://10.180.1.21/identity {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.343089] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.cafile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.343252] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.certfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.343461] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.collect_timing = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.343638] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.connect_retries = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.343796] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.connect_retry_delay = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.343948] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.default_domain_id = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.344114] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.default_domain_name = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.344267] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.domain_id = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.344424] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.domain_name = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.344568] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.endpoint_override = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.344722] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.insecure = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.344871] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.keyfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.345028] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.max_version = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.345181] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.min_version = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.345345] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.password = **** {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.345498] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.project_domain_id = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.345658] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.project_domain_name = Default {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.345842] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.project_id = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.346038] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.project_name = service {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.346211] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.region_name = RegionOne {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.346392] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.service_name = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.346569] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.service_type = placement {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.346727] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.split_loggers = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.346878] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.status_code_retries = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.347042] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.status_code_retry_delay = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.347199] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.system_scope = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.347351] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.timeout = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.347500] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.trust_id = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.347653] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.user_domain_id = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.347815] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.user_domain_name = Default {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.347966] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.user_id = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.348153] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.username = placement {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.348333] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.348489] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] placement.version = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.348659] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] quota.cores = 20 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.348815] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] quota.count_usage_from_placement = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.348978] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.349175] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] quota.injected_file_content_bytes = 10240 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.349337] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] quota.injected_file_path_length = 255 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.349529] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] quota.injected_files = 5 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.349689] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] quota.instances = 10 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.349853] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] quota.key_pairs = 100 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.350019] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] quota.metadata_items = 128 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.350219] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] quota.ram = 51200 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.350337] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] quota.recheck_quota = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.350497] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] quota.server_group_members = 10 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.350654] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] quota.server_groups = 10 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.350881] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] rdp.enabled = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.351225] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.351442] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.351630] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.351795] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] scheduler.image_metadata_prefilter = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.351970] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.352146] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] scheduler.max_attempts = 3 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.352329] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] scheduler.max_placement_results = 1000 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.352545] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.352732] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] scheduler.query_placement_for_availability_zone = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.352918] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] scheduler.query_placement_for_image_type_support = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.353109] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.353314] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] scheduler.workers = 2 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.353540] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.353713] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.353908] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.354095] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.354271] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.354421] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.354583] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.354791] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.354955] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] filter_scheduler.host_subset_size = 1 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.355127] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.355289] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.355475] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] filter_scheduler.isolated_hosts = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.355699] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] filter_scheduler.isolated_images = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.355945] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.356145] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.356312] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] filter_scheduler.pci_in_placement = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.356475] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.356633] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.356791] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.356946] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.357117] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.357279] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.357460] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] filter_scheduler.track_instance_changes = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.357637] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.357802] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] metrics.required = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.358007] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] metrics.weight_multiplier = 1.0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.358186] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] metrics.weight_of_unavailable = -10000.0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.358349] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] metrics.weight_setting = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.358664] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.358838] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] serial_console.enabled = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.359038] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] serial_console.port_range = 10000:20000 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.359210] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.359373] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.359553] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] serial_console.serialproxy_port = 6083 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.359714] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] service_user.auth_section = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.359887] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] service_user.auth_type = password {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.360054] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] service_user.cafile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.360220] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] service_user.certfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.360369] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] service_user.collect_timing = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.360527] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] service_user.insecure = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.360676] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] service_user.keyfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.360843] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] service_user.send_service_user_token = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.360998] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] service_user.split_loggers = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.361165] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] service_user.timeout = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.361329] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] spice.agent_enabled = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.361511] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] spice.enabled = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.361845] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.362088] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] spice.html5proxy_host = 0.0.0.0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.362262] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] spice.html5proxy_port = 6082 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.362451] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] spice.image_compression = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.362616] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] spice.jpeg_compression = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.362773] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] spice.playback_compression = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.362959] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] spice.server_listen = 127.0.0.1 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.363165] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.363327] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] spice.streaming_mode = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.363510] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] spice.zlib_compression = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.363682] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] upgrade_levels.baseapi = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.363837] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] upgrade_levels.cert = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.364015] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] upgrade_levels.compute = auto {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.364183] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] upgrade_levels.conductor = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.364338] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] upgrade_levels.scheduler = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.364505] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vendordata_dynamic_auth.auth_section = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.364659] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vendordata_dynamic_auth.auth_type = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.364814] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vendordata_dynamic_auth.cafile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.364966] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vendordata_dynamic_auth.certfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.365137] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.365298] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vendordata_dynamic_auth.insecure = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.365449] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vendordata_dynamic_auth.keyfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.365607] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.365759] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vendordata_dynamic_auth.timeout = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.365961] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vmware.api_retry_count = 10 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.366130] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vmware.ca_file = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.366286] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vmware.cache_prefix = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.366437] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vmware.cluster_name = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.366593] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vmware.connection_pool_size = 10 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.366745] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vmware.console_delay_seconds = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.366900] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vmware.datastore_regex = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.367065] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vmware.host_ip = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.367221] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vmware.host_password = **** {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.367380] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vmware.host_port = 443 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.367533] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vmware.host_username = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.367693] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vmware.insecure = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.367849] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vmware.integration_bridge = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.368009] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vmware.maximum_objects = 100 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.368174] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vmware.pbm_default_policy = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.368330] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vmware.pbm_enabled = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.368482] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vmware.pbm_wsdl_location = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.368643] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.368795] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vmware.serial_port_proxy_uri = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.368947] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vmware.serial_port_service_uri = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.369119] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vmware.task_poll_interval = 0.5 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.369278] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vmware.use_linked_clone = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.369438] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vmware.vnc_keymap = en-us {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.369598] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vmware.vnc_port = 5900 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.369757] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vmware.vnc_port_total = 10000 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.369959] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vnc.auth_schemes = ['none'] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.370148] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vnc.enabled = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.370449] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.370630] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.370800] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vnc.novncproxy_port = 6080 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.370974] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vnc.server_listen = 127.0.0.1 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.371156] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.371318] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vnc.vencrypt_ca_certs = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.371471] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vnc.vencrypt_client_cert = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.371642] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] vnc.vencrypt_client_key = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.371846] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.372025] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] workarounds.disable_deep_image_inspection = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.372182] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.372357] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] workarounds.disable_group_policy_check_upcall = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.372522] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.372685] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] workarounds.disable_rootwrap = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.372842] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] workarounds.enable_numa_live_migration = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.372998] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.373167] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.373327] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.373499] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] workarounds.libvirt_disable_apic = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.373680] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.373841] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.373995] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.374164] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.374321] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.374477] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.374906] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.374906] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.374961] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.375113] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.375314] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.375483] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] wsgi.client_socket_timeout = 900 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.375642] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] wsgi.default_pool_size = 1000 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.375824] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] wsgi.keep_alive = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.375985] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] wsgi.max_header_line = 16384 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.376153] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] wsgi.secure_proxy_ssl_header = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.376309] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] wsgi.ssl_ca_file = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.376470] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] wsgi.ssl_cert_file = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.376618] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] wsgi.ssl_key_file = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.376774] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] wsgi.tcp_keepidle = 600 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.376940] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.377119] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] zvm.ca_file = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.377279] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] zvm.cloud_connector_url = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.377500] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.377733] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] zvm.reachable_timeout = 300 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.377991] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_policy.enforce_new_defaults = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.378183] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_policy.enforce_scope = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.378374] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_policy.policy_default_rule = default {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.378569] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.378756] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_policy.policy_file = policy.yaml {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.378947] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.379133] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.379290] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.379472] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.379630] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.379817] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.379996] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.380214] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] profiler.connection_string = messaging:// {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.380381] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] profiler.enabled = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.380565] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] profiler.es_doc_type = notification {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.380741] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] profiler.es_scroll_size = 10000 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.380906] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] profiler.es_scroll_time = 2m {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.381072] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] profiler.filter_error_trace = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.381249] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] profiler.hmac_keys = SECRET_KEY {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.381411] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] profiler.sentinel_service_name = mymaster {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.381592] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] profiler.socket_timeout = 0.1 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.381753] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] profiler.trace_sqlalchemy = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.381940] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] remote_debug.host = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.382131] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] remote_debug.port = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.382339] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.382518] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.382681] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.382842] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.383010] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.383173] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.383363] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.383557] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.383718] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.383876] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.384054] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.384219] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.384389] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.384555] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.384735] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.384915] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.385085] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.385243] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.385403] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.385560] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.385715] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.385873] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.386037] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.386202] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.386364] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.386529] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.ssl = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.386694] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.386856] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.387022] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.387196] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.387360] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_rabbit.ssl_version = {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.387572] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.387753] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_notifications.retry = -1 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.387933] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.388133] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_messaging_notifications.transport_url = **** {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.388330] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_limit.auth_section = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.388495] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_limit.auth_type = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.388646] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_limit.cafile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.388798] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_limit.certfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.388951] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_limit.collect_timing = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.389113] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_limit.connect_retries = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.389268] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_limit.connect_retry_delay = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.389424] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_limit.endpoint_id = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.389610] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_limit.endpoint_override = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.389727] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_limit.insecure = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.389875] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_limit.keyfile = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.390031] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_limit.max_version = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.390188] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_limit.min_version = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.390338] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_limit.region_name = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.390507] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_limit.service_name = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.390659] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_limit.service_type = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.390812] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_limit.split_loggers = False {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.390961] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_limit.status_code_retries = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.391126] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_limit.status_code_retry_delay = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.391278] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_limit.timeout = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.391436] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_limit.valid_interfaces = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.391593] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_limit.version = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.391790] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_reports.file_event_handler = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.391966] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.392130] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] oslo_reports.log_dir = None {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 420.392256] nova-conductor[52581]: DEBUG oslo_service.service [None req-9c27603c-a34c-4ea7-bc3d-e56173166a99 None None] ******************************************************************************** {{(pid=52581) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} [ 509.832155] nova-conductor[53002]: DEBUG oslo_db.sqlalchemy.engines [None req-6e13185b-4238-4155-8ffa-0c352c4e280a None None] Parent process 52581 forked (53002) with an open database connection, which is being discarded and recreated. {{(pid=53002) checkout /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:434}} [ 554.932719] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=53002) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 554.957552] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 554.957717] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 554.959808] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 554.967288] nova-conductor[53002]: DEBUG oslo_db.sqlalchemy.engines [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=53002) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 555.033294] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 555.033530] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 555.034399] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 555.034540] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 555.034915] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 555.034915] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 555.044550] nova-conductor[53002]: DEBUG oslo_db.sqlalchemy.engines [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=53002) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 555.058579] nova-conductor[53002]: DEBUG nova.quota [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] Getting quotas for project c1b2e2fde40e4ec799922e3ac4780416. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 555.065372] nova-conductor[53002]: DEBUG nova.quota [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] Getting quotas for user 04842364b6554b0098443e52c3519d4b and project c1b2e2fde40e4ec799922e3ac4780416. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 555.073589] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] [instance: b974272a-5c32-4ed2-99db-1b1ac744d08c] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53002) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 555.074487] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 555.075042] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 555.075042] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 555.080404] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] [instance: b974272a-5c32-4ed2-99db-1b1ac744d08c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 555.081323] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 555.081624] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 555.081883] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 555.108970] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 555.109241] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 555.109502] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 555.109709] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=53002) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} [ 555.109887] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] Acquired lock "compute-rpcapi-router" {{(pid=53002) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} [ 555.110480] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-84d63b98-fb8e-4a36-a940-bca29af2c5b4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 555.110705] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-84d63b98-fb8e-4a36-a940-bca29af2c5b4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 555.110796] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-84d63b98-fb8e-4a36-a940-bca29af2c5b4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 555.111155] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-84d63b98-fb8e-4a36-a940-bca29af2c5b4 None None] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 555.111340] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-84d63b98-fb8e-4a36-a940-bca29af2c5b4 None None] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 555.111500] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-84d63b98-fb8e-4a36-a940-bca29af2c5b4 None None] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 555.120205] nova-conductor[53002]: INFO nova.compute.rpcapi [None req-84d63b98-fb8e-4a36-a940-bca29af2c5b4 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 [ 555.120727] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-84d63b98-fb8e-4a36-a940-bca29af2c5b4 None None] Releasing lock "compute-rpcapi-router" {{(pid=53002) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} [ 556.805014] nova-conductor[53001]: DEBUG oslo_db.sqlalchemy.engines [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] Parent process 52581 forked (53001) with an open database connection, which is being discarded and recreated. {{(pid=53001) checkout /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:434}} [ 557.080918] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=53001) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 557.095818] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-943340a9-8bfb-497d-894d-b41b7d054998 tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=53002) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 557.114794] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 557.114794] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 557.116198] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-943340a9-8bfb-497d-894d-b41b7d054998 tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 557.116489] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 557.116743] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-943340a9-8bfb-497d-894d-b41b7d054998 tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 557.116949] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-943340a9-8bfb-497d-894d-b41b7d054998 tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 557.122045] nova-conductor[53001]: DEBUG oslo_db.sqlalchemy.engines [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=53001) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 557.162156] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-943340a9-8bfb-497d-894d-b41b7d054998 tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 557.162156] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-943340a9-8bfb-497d-894d-b41b7d054998 tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 557.162156] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-943340a9-8bfb-497d-894d-b41b7d054998 tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 557.162156] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-943340a9-8bfb-497d-894d-b41b7d054998 tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 557.162494] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-943340a9-8bfb-497d-894d-b41b7d054998 tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 557.162494] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-943340a9-8bfb-497d-894d-b41b7d054998 tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 557.169583] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 557.169936] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 557.170296] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 557.170624] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 557.170817] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 557.170982] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 557.174680] nova-conductor[53002]: DEBUG nova.quota [None req-943340a9-8bfb-497d-894d-b41b7d054998 tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Getting quotas for project 8a91009401dd409ca662573757dfaf88. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 557.180601] nova-conductor[53002]: DEBUG nova.quota [None req-943340a9-8bfb-497d-894d-b41b7d054998 tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Getting quotas for user de88047992ae4098acd029bd2bd55b1f and project 8a91009401dd409ca662573757dfaf88. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 557.186960] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-943340a9-8bfb-497d-894d-b41b7d054998 tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] [instance: 3a7076f4-fc00-4f82-804b-4dac0de9ab3d] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53002) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 557.187698] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-943340a9-8bfb-497d-894d-b41b7d054998 tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 557.189406] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-943340a9-8bfb-497d-894d-b41b7d054998 tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 557.191099] nova-conductor[53001]: DEBUG oslo_db.sqlalchemy.engines [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=53001) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 557.192231] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-943340a9-8bfb-497d-894d-b41b7d054998 tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 557.199023] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-943340a9-8bfb-497d-894d-b41b7d054998 tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] [instance: 3a7076f4-fc00-4f82-804b-4dac0de9ab3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 557.199023] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-943340a9-8bfb-497d-894d-b41b7d054998 tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 557.199023] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-943340a9-8bfb-497d-894d-b41b7d054998 tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 557.199395] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-943340a9-8bfb-497d-894d-b41b7d054998 tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 557.221230] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-943340a9-8bfb-497d-894d-b41b7d054998 tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 557.221471] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-943340a9-8bfb-497d-894d-b41b7d054998 tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 557.221638] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-943340a9-8bfb-497d-894d-b41b7d054998 tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 557.222899] nova-conductor[53001]: DEBUG nova.quota [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] Getting quotas for project 911556aa558a4d248043490afec5ee5e. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 557.230076] nova-conductor[53001]: DEBUG nova.quota [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] Getting quotas for user 4c2b8b857ba94465bb210580868b9c63 and project 911556aa558a4d248043490afec5ee5e. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 557.247108] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] [instance: 31e48a76-ffbc-4bd2-a01f-2a69df2de5f5] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53001) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 557.250123] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 557.250123] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 557.250123] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 557.269047] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] [instance: 31e48a76-ffbc-4bd2-a01f-2a69df2de5f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 557.269722] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 557.271349] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 557.271349] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 557.348681] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 557.349036] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 557.351180] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 557.353601] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=53001) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} [ 557.353601] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] Acquired lock "compute-rpcapi-router" {{(pid=53001) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} [ 557.353601] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-96423f82-d42d-4afc-a37e-2ef04ac81396 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 557.353601] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-96423f82-d42d-4afc-a37e-2ef04ac81396 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 557.353601] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-96423f82-d42d-4afc-a37e-2ef04ac81396 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 557.353932] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-96423f82-d42d-4afc-a37e-2ef04ac81396 None None] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 557.353932] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-96423f82-d42d-4afc-a37e-2ef04ac81396 None None] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 557.353932] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-96423f82-d42d-4afc-a37e-2ef04ac81396 None None] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 557.359677] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-cc008bbb-da29-413c-8d6f-cbe86f0a9d3f tempest-ServerDiagnosticsV248Test-603941409 tempest-ServerDiagnosticsV248Test-603941409-project-member] Took 0.17 seconds to select destinations for 1 instance(s). {{(pid=53001) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 557.373031] nova-conductor[53001]: INFO nova.compute.rpcapi [None req-96423f82-d42d-4afc-a37e-2ef04ac81396 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 [ 557.373570] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-96423f82-d42d-4afc-a37e-2ef04ac81396 None None] Releasing lock "compute-rpcapi-router" {{(pid=53001) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} [ 557.383557] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-cc008bbb-da29-413c-8d6f-cbe86f0a9d3f tempest-ServerDiagnosticsV248Test-603941409 tempest-ServerDiagnosticsV248Test-603941409-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 557.383836] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-cc008bbb-da29-413c-8d6f-cbe86f0a9d3f tempest-ServerDiagnosticsV248Test-603941409 tempest-ServerDiagnosticsV248Test-603941409-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 557.384032] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-cc008bbb-da29-413c-8d6f-cbe86f0a9d3f tempest-ServerDiagnosticsV248Test-603941409 tempest-ServerDiagnosticsV248Test-603941409-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 557.436026] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-cc008bbb-da29-413c-8d6f-cbe86f0a9d3f tempest-ServerDiagnosticsV248Test-603941409 tempest-ServerDiagnosticsV248Test-603941409-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 557.436026] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-cc008bbb-da29-413c-8d6f-cbe86f0a9d3f tempest-ServerDiagnosticsV248Test-603941409 tempest-ServerDiagnosticsV248Test-603941409-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 557.436026] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-cc008bbb-da29-413c-8d6f-cbe86f0a9d3f tempest-ServerDiagnosticsV248Test-603941409 tempest-ServerDiagnosticsV248Test-603941409-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 557.436305] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-cc008bbb-da29-413c-8d6f-cbe86f0a9d3f tempest-ServerDiagnosticsV248Test-603941409 tempest-ServerDiagnosticsV248Test-603941409-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 557.436354] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-cc008bbb-da29-413c-8d6f-cbe86f0a9d3f tempest-ServerDiagnosticsV248Test-603941409 tempest-ServerDiagnosticsV248Test-603941409-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 557.436517] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-cc008bbb-da29-413c-8d6f-cbe86f0a9d3f tempest-ServerDiagnosticsV248Test-603941409 tempest-ServerDiagnosticsV248Test-603941409-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 557.460245] nova-conductor[53001]: DEBUG nova.quota [None req-cc008bbb-da29-413c-8d6f-cbe86f0a9d3f tempest-ServerDiagnosticsV248Test-603941409 tempest-ServerDiagnosticsV248Test-603941409-project-member] Getting quotas for project d9c6fc1f21434ba8adf24e3dea4eba36. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 557.463162] nova-conductor[53001]: DEBUG nova.quota [None req-cc008bbb-da29-413c-8d6f-cbe86f0a9d3f tempest-ServerDiagnosticsV248Test-603941409 tempest-ServerDiagnosticsV248Test-603941409-project-member] Getting quotas for user e8293cb0126249aeb94b4ef27bd75c97 and project d9c6fc1f21434ba8adf24e3dea4eba36. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 557.478764] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-cc008bbb-da29-413c-8d6f-cbe86f0a9d3f tempest-ServerDiagnosticsV248Test-603941409 tempest-ServerDiagnosticsV248Test-603941409-project-member] [instance: d76e8d11-53d3-417d-b6a6-08bdff8165d5] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53001) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 557.480445] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-cc008bbb-da29-413c-8d6f-cbe86f0a9d3f tempest-ServerDiagnosticsV248Test-603941409 tempest-ServerDiagnosticsV248Test-603941409-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 557.481777] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-cc008bbb-da29-413c-8d6f-cbe86f0a9d3f tempest-ServerDiagnosticsV248Test-603941409 tempest-ServerDiagnosticsV248Test-603941409-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 557.481777] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-cc008bbb-da29-413c-8d6f-cbe86f0a9d3f tempest-ServerDiagnosticsV248Test-603941409 tempest-ServerDiagnosticsV248Test-603941409-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 557.489864] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-cc008bbb-da29-413c-8d6f-cbe86f0a9d3f tempest-ServerDiagnosticsV248Test-603941409 tempest-ServerDiagnosticsV248Test-603941409-project-member] [instance: d76e8d11-53d3-417d-b6a6-08bdff8165d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 557.491949] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-cc008bbb-da29-413c-8d6f-cbe86f0a9d3f tempest-ServerDiagnosticsV248Test-603941409 tempest-ServerDiagnosticsV248Test-603941409-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 557.492396] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-cc008bbb-da29-413c-8d6f-cbe86f0a9d3f tempest-ServerDiagnosticsV248Test-603941409 tempest-ServerDiagnosticsV248Test-603941409-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 557.492396] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-cc008bbb-da29-413c-8d6f-cbe86f0a9d3f tempest-ServerDiagnosticsV248Test-603941409 tempest-ServerDiagnosticsV248Test-603941409-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 557.508925] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-cc008bbb-da29-413c-8d6f-cbe86f0a9d3f tempest-ServerDiagnosticsV248Test-603941409 tempest-ServerDiagnosticsV248Test-603941409-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 557.509170] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-cc008bbb-da29-413c-8d6f-cbe86f0a9d3f tempest-ServerDiagnosticsV248Test-603941409 tempest-ServerDiagnosticsV248Test-603941409-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 557.509339] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-cc008bbb-da29-413c-8d6f-cbe86f0a9d3f tempest-ServerDiagnosticsV248Test-603941409 tempest-ServerDiagnosticsV248Test-603941409-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 565.664943] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Took 0.16 seconds to select destinations for 1 instance(s). {{(pid=53001) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 565.680123] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 565.680385] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 565.680716] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 565.719915] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 565.720284] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 565.720510] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 565.720968] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 565.721229] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 565.721430] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 565.734392] nova-conductor[53001]: DEBUG nova.quota [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Getting quotas for project 1f23b8194c69430d893ed629fc9ba2c8. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 565.737172] nova-conductor[53001]: DEBUG nova.quota [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Getting quotas for user 1e283359256141eda083eb00dd5ebbab and project 1f23b8194c69430d893ed629fc9ba2c8. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 565.751083] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] [instance: 9a14b9d0-876b-45c6-825e-103caac6bef9] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53001) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 565.751694] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 565.751914] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 565.752102] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 565.755915] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] [instance: 9a14b9d0-876b-45c6-825e-103caac6bef9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 565.756620] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 565.756881] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 565.757009] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 565.780300] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 565.780536] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 565.780711] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 566.565829] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-e2551337-bf2e-49c0-bb2a-4d923160bab9 tempest-ServersAdmin275Test-568000092 tempest-ServersAdmin275Test-568000092-project-member] Took 0.18 seconds to select destinations for 1 instance(s). {{(pid=53002) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 566.586319] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e2551337-bf2e-49c0-bb2a-4d923160bab9 tempest-ServersAdmin275Test-568000092 tempest-ServersAdmin275Test-568000092-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 566.586547] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e2551337-bf2e-49c0-bb2a-4d923160bab9 tempest-ServersAdmin275Test-568000092 tempest-ServersAdmin275Test-568000092-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 566.586739] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e2551337-bf2e-49c0-bb2a-4d923160bab9 tempest-ServersAdmin275Test-568000092 tempest-ServersAdmin275Test-568000092-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 566.623659] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e2551337-bf2e-49c0-bb2a-4d923160bab9 tempest-ServersAdmin275Test-568000092 tempest-ServersAdmin275Test-568000092-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 566.623946] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e2551337-bf2e-49c0-bb2a-4d923160bab9 tempest-ServersAdmin275Test-568000092 tempest-ServersAdmin275Test-568000092-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 566.624295] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e2551337-bf2e-49c0-bb2a-4d923160bab9 tempest-ServersAdmin275Test-568000092 tempest-ServersAdmin275Test-568000092-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 566.624589] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e2551337-bf2e-49c0-bb2a-4d923160bab9 tempest-ServersAdmin275Test-568000092 tempest-ServersAdmin275Test-568000092-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 566.624779] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e2551337-bf2e-49c0-bb2a-4d923160bab9 tempest-ServersAdmin275Test-568000092 tempest-ServersAdmin275Test-568000092-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 566.624955] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e2551337-bf2e-49c0-bb2a-4d923160bab9 tempest-ServersAdmin275Test-568000092 tempest-ServersAdmin275Test-568000092-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 566.636313] nova-conductor[53002]: DEBUG nova.quota [None req-e2551337-bf2e-49c0-bb2a-4d923160bab9 tempest-ServersAdmin275Test-568000092 tempest-ServersAdmin275Test-568000092-project-member] Getting quotas for project 856c0560e661462ab33a15624adf3b15. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 566.639471] nova-conductor[53002]: DEBUG nova.quota [None req-e2551337-bf2e-49c0-bb2a-4d923160bab9 tempest-ServersAdmin275Test-568000092 tempest-ServersAdmin275Test-568000092-project-member] Getting quotas for user 8e8bb561d34041c09241223aee80c8f9 and project 856c0560e661462ab33a15624adf3b15. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 566.646127] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-e2551337-bf2e-49c0-bb2a-4d923160bab9 tempest-ServersAdmin275Test-568000092 tempest-ServersAdmin275Test-568000092-project-member] [instance: b2a1b0c6-91cd-437d-b5bf-ca618b008c23] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53002) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 566.646675] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e2551337-bf2e-49c0-bb2a-4d923160bab9 tempest-ServersAdmin275Test-568000092 tempest-ServersAdmin275Test-568000092-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 566.646889] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e2551337-bf2e-49c0-bb2a-4d923160bab9 tempest-ServersAdmin275Test-568000092 tempest-ServersAdmin275Test-568000092-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 566.647079] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e2551337-bf2e-49c0-bb2a-4d923160bab9 tempest-ServersAdmin275Test-568000092 tempest-ServersAdmin275Test-568000092-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 566.652431] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-e2551337-bf2e-49c0-bb2a-4d923160bab9 tempest-ServersAdmin275Test-568000092 tempest-ServersAdmin275Test-568000092-project-member] [instance: b2a1b0c6-91cd-437d-b5bf-ca618b008c23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 566.652431] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e2551337-bf2e-49c0-bb2a-4d923160bab9 tempest-ServersAdmin275Test-568000092 tempest-ServersAdmin275Test-568000092-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 566.652431] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e2551337-bf2e-49c0-bb2a-4d923160bab9 tempest-ServersAdmin275Test-568000092 tempest-ServersAdmin275Test-568000092-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 566.652760] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e2551337-bf2e-49c0-bb2a-4d923160bab9 tempest-ServersAdmin275Test-568000092 tempest-ServersAdmin275Test-568000092-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 566.668740] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e2551337-bf2e-49c0-bb2a-4d923160bab9 tempest-ServersAdmin275Test-568000092 tempest-ServersAdmin275Test-568000092-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 566.668740] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e2551337-bf2e-49c0-bb2a-4d923160bab9 tempest-ServersAdmin275Test-568000092 tempest-ServersAdmin275Test-568000092-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 566.668874] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e2551337-bf2e-49c0-bb2a-4d923160bab9 tempest-ServersAdmin275Test-568000092 tempest-ServersAdmin275Test-568000092-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 573.793016] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Took 0.23 seconds to select destinations for 1 instance(s). {{(pid=53002) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 573.807794] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 573.807794] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 573.807794] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 573.843438] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 573.843829] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 573.844532] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 573.844606] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 573.844931] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 573.845073] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 573.854636] nova-conductor[53002]: DEBUG nova.quota [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Getting quotas for project 8494da0659724fdfa3b4021c74cd6897. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 573.859173] nova-conductor[53002]: DEBUG nova.quota [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Getting quotas for user 9a5a7c5287174e1785ed2db5b3fec2a6 and project 8494da0659724fdfa3b4021c74cd6897. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 573.864945] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] [instance: b14d8d3f-9253-4e5f-a5b8-09a2f43888a6] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53002) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 573.865561] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 573.865704] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 573.865868] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 573.869212] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] [instance: b14d8d3f-9253-4e5f-a5b8-09a2f43888a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 573.869867] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 573.870090] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 573.870269] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 573.900917] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 573.901208] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 573.901406] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 574.547333] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] Took 0.17 seconds to select destinations for 1 instance(s). {{(pid=53002) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 574.561728] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 574.562130] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 574.562420] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 574.604644] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 574.605656] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 574.605656] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 574.605656] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 574.606883] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 574.606883] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 574.633019] nova-conductor[53002]: DEBUG nova.quota [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] Getting quotas for project 54433cd0d39244edab2bd1e18d2ffe3c. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 574.633019] nova-conductor[53002]: DEBUG nova.quota [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] Getting quotas for user a192e518ab934e77befe2a60bac042ef and project 54433cd0d39244edab2bd1e18d2ffe3c. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 574.639812] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] [instance: 386edc81-5f27-4e44-af7a-f5e47ded1327] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53002) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 574.639812] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 574.640154] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 574.640296] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 574.644796] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] [instance: 386edc81-5f27-4e44-af7a-f5e47ded1327] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 574.644796] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 574.645271] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 574.645501] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 574.665730] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 574.665813] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 574.665971] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 576.851388] nova-conductor[53002]: ERROR nova.conductor.manager [None req-0fcfd1de-380b-4be2-828b-3855c1d57fad tempest-MigrationsAdminTest-1918173476 tempest-MigrationsAdminTest-1918173476-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 576.851388] nova-conductor[53002]: Traceback (most recent call last): [ 576.851388] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 576.851388] nova-conductor[53002]: return func(*args, **kwargs) [ 576.851388] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 576.851388] nova-conductor[53002]: selections = self._select_destinations( [ 576.851388] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 576.851388] nova-conductor[53002]: selections = self._schedule( [ 576.851388] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 576.851388] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 576.851388] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 576.851388] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 576.851388] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 576.851388] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 576.851388] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 576.851388] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 576.851388] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 576.851388] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 576.851388] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 576.851388] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 576.851388] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 576.852168] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 576.852168] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 576.852168] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 576.852168] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 576.852168] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 576.852168] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 576.852168] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 576.852168] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 576.852168] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 576.852168] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 576.852168] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 576.852168] nova-conductor[53002]: ERROR nova.conductor.manager [ 576.852168] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 576.852168] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 576.852168] nova-conductor[53002]: ERROR nova.conductor.manager [ 576.852168] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 576.852168] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 576.852168] nova-conductor[53002]: ERROR nova.conductor.manager [ 576.852168] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 576.852168] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 576.852168] nova-conductor[53002]: ERROR nova.conductor.manager [ 576.852713] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 576.852713] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 576.852713] nova-conductor[53002]: ERROR nova.conductor.manager [ 576.852713] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 576.852713] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 576.852713] nova-conductor[53002]: ERROR nova.conductor.manager [ 576.852713] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 576.852713] nova-conductor[53002]: ERROR nova.conductor.manager [ 576.852713] nova-conductor[53002]: ERROR nova.conductor.manager [ 576.867174] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-0fcfd1de-380b-4be2-828b-3855c1d57fad tempest-MigrationsAdminTest-1918173476 tempest-MigrationsAdminTest-1918173476-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 576.867462] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-0fcfd1de-380b-4be2-828b-3855c1d57fad tempest-MigrationsAdminTest-1918173476 tempest-MigrationsAdminTest-1918173476-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 576.867689] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-0fcfd1de-380b-4be2-828b-3855c1d57fad tempest-MigrationsAdminTest-1918173476 tempest-MigrationsAdminTest-1918173476-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 576.882824] nova-conductor[53001]: ERROR nova.conductor.manager [None req-3287507c-195e-49cd-b22b-ec6eb0d8ad31 tempest-ServersWithSpecificFlavorTestJSON-1617212719 tempest-ServersWithSpecificFlavorTestJSON-1617212719-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 576.882824] nova-conductor[53001]: Traceback (most recent call last): [ 576.882824] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 576.882824] nova-conductor[53001]: return func(*args, **kwargs) [ 576.882824] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 576.882824] nova-conductor[53001]: selections = self._select_destinations( [ 576.882824] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 576.882824] nova-conductor[53001]: selections = self._schedule( [ 576.882824] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 576.882824] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 576.882824] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 576.882824] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 576.882824] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 576.882824] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 576.882824] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 576.882824] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 576.882824] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 576.882824] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 576.882824] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 576.882824] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 576.883566] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 576.883566] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 576.883566] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 576.883566] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 576.883566] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 576.883566] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 576.883566] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 576.883566] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 576.883566] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 576.883566] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 576.883566] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 576.883566] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 576.883566] nova-conductor[53001]: ERROR nova.conductor.manager [ 576.883566] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 576.883566] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 576.883566] nova-conductor[53001]: ERROR nova.conductor.manager [ 576.883566] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 576.883566] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 576.883566] nova-conductor[53001]: ERROR nova.conductor.manager [ 576.884082] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 576.884082] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 576.884082] nova-conductor[53001]: ERROR nova.conductor.manager [ 576.884082] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 576.884082] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 576.884082] nova-conductor[53001]: ERROR nova.conductor.manager [ 576.884082] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 576.884082] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 576.884082] nova-conductor[53001]: ERROR nova.conductor.manager [ 576.884082] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 576.884082] nova-conductor[53001]: ERROR nova.conductor.manager [ 576.884082] nova-conductor[53001]: ERROR nova.conductor.manager [ 576.895087] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-3287507c-195e-49cd-b22b-ec6eb0d8ad31 tempest-ServersWithSpecificFlavorTestJSON-1617212719 tempest-ServersWithSpecificFlavorTestJSON-1617212719-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 576.895361] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-3287507c-195e-49cd-b22b-ec6eb0d8ad31 tempest-ServersWithSpecificFlavorTestJSON-1617212719 tempest-ServersWithSpecificFlavorTestJSON-1617212719-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 576.895536] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-3287507c-195e-49cd-b22b-ec6eb0d8ad31 tempest-ServersWithSpecificFlavorTestJSON-1617212719 tempest-ServersWithSpecificFlavorTestJSON-1617212719-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 576.934274] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-0fcfd1de-380b-4be2-828b-3855c1d57fad tempest-MigrationsAdminTest-1918173476 tempest-MigrationsAdminTest-1918173476-project-member] [instance: 38b49d72-a468-48f3-9eda-47436dd7c9e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 576.935425] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-0fcfd1de-380b-4be2-828b-3855c1d57fad tempest-MigrationsAdminTest-1918173476 tempest-MigrationsAdminTest-1918173476-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 576.935774] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-0fcfd1de-380b-4be2-828b-3855c1d57fad tempest-MigrationsAdminTest-1918173476 tempest-MigrationsAdminTest-1918173476-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 576.935969] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-0fcfd1de-380b-4be2-828b-3855c1d57fad tempest-MigrationsAdminTest-1918173476 tempest-MigrationsAdminTest-1918173476-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 576.947280] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-0fcfd1de-380b-4be2-828b-3855c1d57fad tempest-MigrationsAdminTest-1918173476 tempest-MigrationsAdminTest-1918173476-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 576.947280] nova-conductor[53002]: Traceback (most recent call last): [ 576.947280] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 576.947280] nova-conductor[53002]: return func(*args, **kwargs) [ 576.947280] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 576.947280] nova-conductor[53002]: selections = self._select_destinations( [ 576.947280] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 576.947280] nova-conductor[53002]: selections = self._schedule( [ 576.947280] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 576.947280] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 576.947280] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 576.947280] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 576.947280] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 576.947280] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 576.949567] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-0fcfd1de-380b-4be2-828b-3855c1d57fad tempest-MigrationsAdminTest-1918173476 tempest-MigrationsAdminTest-1918173476-project-member] [instance: 38b49d72-a468-48f3-9eda-47436dd7c9e7] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 576.982875] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-3287507c-195e-49cd-b22b-ec6eb0d8ad31 tempest-ServersWithSpecificFlavorTestJSON-1617212719 tempest-ServersWithSpecificFlavorTestJSON-1617212719-project-member] [instance: 93769d1c-c7ad-415c-9f41-0908cdbffd13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 576.983684] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-3287507c-195e-49cd-b22b-ec6eb0d8ad31 tempest-ServersWithSpecificFlavorTestJSON-1617212719 tempest-ServersWithSpecificFlavorTestJSON-1617212719-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 576.983897] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-3287507c-195e-49cd-b22b-ec6eb0d8ad31 tempest-ServersWithSpecificFlavorTestJSON-1617212719 tempest-ServersWithSpecificFlavorTestJSON-1617212719-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 576.984298] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-3287507c-195e-49cd-b22b-ec6eb0d8ad31 tempest-ServersWithSpecificFlavorTestJSON-1617212719 tempest-ServersWithSpecificFlavorTestJSON-1617212719-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 576.992039] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-3287507c-195e-49cd-b22b-ec6eb0d8ad31 tempest-ServersWithSpecificFlavorTestJSON-1617212719 tempest-ServersWithSpecificFlavorTestJSON-1617212719-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 576.992039] nova-conductor[53001]: Traceback (most recent call last): [ 576.992039] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 576.992039] nova-conductor[53001]: return func(*args, **kwargs) [ 576.992039] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 576.992039] nova-conductor[53001]: selections = self._select_destinations( [ 576.992039] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 576.992039] nova-conductor[53001]: selections = self._schedule( [ 576.992039] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 576.992039] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 576.992039] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 576.992039] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 576.992039] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 576.992039] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 576.993436] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-3287507c-195e-49cd-b22b-ec6eb0d8ad31 tempest-ServersWithSpecificFlavorTestJSON-1617212719 tempest-ServersWithSpecificFlavorTestJSON-1617212719-project-member] [instance: 93769d1c-c7ad-415c-9f41-0908cdbffd13] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 579.651498] nova-conductor[53001]: ERROR nova.conductor.manager [None req-f6cc99bc-7843-46ae-b8db-ad00d9aae3d2 tempest-ServerActionsTestJSON-792949534 tempest-ServerActionsTestJSON-792949534-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 579.651498] nova-conductor[53001]: Traceback (most recent call last): [ 579.651498] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 579.651498] nova-conductor[53001]: return func(*args, **kwargs) [ 579.651498] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 579.651498] nova-conductor[53001]: selections = self._select_destinations( [ 579.651498] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 579.651498] nova-conductor[53001]: selections = self._schedule( [ 579.651498] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 579.651498] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 579.651498] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 579.651498] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 579.651498] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 579.651498] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 579.651498] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 579.651498] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 579.651498] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 579.651498] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 579.651498] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 579.651498] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 579.651498] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 579.652599] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 579.652599] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 579.652599] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 579.652599] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 579.652599] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 579.652599] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 579.652599] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 579.652599] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 579.652599] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 579.652599] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 579.652599] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 579.652599] nova-conductor[53001]: ERROR nova.conductor.manager [ 579.652599] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 579.652599] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 579.652599] nova-conductor[53001]: ERROR nova.conductor.manager [ 579.652599] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 579.652599] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 579.652599] nova-conductor[53001]: ERROR nova.conductor.manager [ 579.652599] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 579.652599] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 579.652599] nova-conductor[53001]: ERROR nova.conductor.manager [ 579.653111] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 579.653111] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 579.653111] nova-conductor[53001]: ERROR nova.conductor.manager [ 579.653111] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 579.653111] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 579.653111] nova-conductor[53001]: ERROR nova.conductor.manager [ 579.653111] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 579.653111] nova-conductor[53001]: ERROR nova.conductor.manager [ 579.653111] nova-conductor[53001]: ERROR nova.conductor.manager [ 579.660534] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f6cc99bc-7843-46ae-b8db-ad00d9aae3d2 tempest-ServerActionsTestJSON-792949534 tempest-ServerActionsTestJSON-792949534-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 579.660780] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f6cc99bc-7843-46ae-b8db-ad00d9aae3d2 tempest-ServerActionsTestJSON-792949534 tempest-ServerActionsTestJSON-792949534-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 579.661203] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f6cc99bc-7843-46ae-b8db-ad00d9aae3d2 tempest-ServerActionsTestJSON-792949534 tempest-ServerActionsTestJSON-792949534-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 579.713627] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-f6cc99bc-7843-46ae-b8db-ad00d9aae3d2 tempest-ServerActionsTestJSON-792949534 tempest-ServerActionsTestJSON-792949534-project-member] [instance: 4b82d0e7-bdff-4ffd-917d-0f6cef110891] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 579.719021] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f6cc99bc-7843-46ae-b8db-ad00d9aae3d2 tempest-ServerActionsTestJSON-792949534 tempest-ServerActionsTestJSON-792949534-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 579.720389] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f6cc99bc-7843-46ae-b8db-ad00d9aae3d2 tempest-ServerActionsTestJSON-792949534 tempest-ServerActionsTestJSON-792949534-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 579.720389] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f6cc99bc-7843-46ae-b8db-ad00d9aae3d2 tempest-ServerActionsTestJSON-792949534 tempest-ServerActionsTestJSON-792949534-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 579.728413] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-f6cc99bc-7843-46ae-b8db-ad00d9aae3d2 tempest-ServerActionsTestJSON-792949534 tempest-ServerActionsTestJSON-792949534-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 579.728413] nova-conductor[53001]: Traceback (most recent call last): [ 579.728413] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 579.728413] nova-conductor[53001]: return func(*args, **kwargs) [ 579.728413] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 579.728413] nova-conductor[53001]: selections = self._select_destinations( [ 579.728413] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 579.728413] nova-conductor[53001]: selections = self._schedule( [ 579.728413] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 579.728413] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 579.728413] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 579.728413] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 579.728413] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 579.728413] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 579.728888] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-f6cc99bc-7843-46ae-b8db-ad00d9aae3d2 tempest-ServerActionsTestJSON-792949534 tempest-ServerActionsTestJSON-792949534-project-member] [instance: 4b82d0e7-bdff-4ffd-917d-0f6cef110891] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 582.128529] nova-conductor[53001]: ERROR nova.conductor.manager [None req-729cf657-423a-44fc-a6a0-f7af5f1c8cd2 tempest-FloatingIPsAssociationTestJSON-1872521600 tempest-FloatingIPsAssociationTestJSON-1872521600-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 582.128529] nova-conductor[53001]: Traceback (most recent call last): [ 582.128529] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 582.128529] nova-conductor[53001]: return func(*args, **kwargs) [ 582.128529] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 582.128529] nova-conductor[53001]: selections = self._select_destinations( [ 582.128529] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 582.128529] nova-conductor[53001]: selections = self._schedule( [ 582.128529] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 582.128529] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 582.128529] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 582.128529] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 582.128529] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 582.128529] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 582.128529] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 582.128529] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 582.128529] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 582.128529] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 582.128529] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 582.128529] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 582.129527] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 582.129527] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 582.129527] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 582.129527] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 582.129527] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 582.129527] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 582.129527] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 582.129527] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 582.129527] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 582.129527] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 582.129527] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 582.129527] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 582.129527] nova-conductor[53001]: ERROR nova.conductor.manager [ 582.129527] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 582.129527] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 582.129527] nova-conductor[53001]: ERROR nova.conductor.manager [ 582.129527] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 582.129527] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 582.129527] nova-conductor[53001]: ERROR nova.conductor.manager [ 582.130578] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 582.130578] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 582.130578] nova-conductor[53001]: ERROR nova.conductor.manager [ 582.130578] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 582.130578] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 582.130578] nova-conductor[53001]: ERROR nova.conductor.manager [ 582.130578] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 582.130578] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 582.130578] nova-conductor[53001]: ERROR nova.conductor.manager [ 582.130578] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 582.130578] nova-conductor[53001]: ERROR nova.conductor.manager [ 582.130578] nova-conductor[53001]: ERROR nova.conductor.manager [ 582.142560] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-729cf657-423a-44fc-a6a0-f7af5f1c8cd2 tempest-FloatingIPsAssociationTestJSON-1872521600 tempest-FloatingIPsAssociationTestJSON-1872521600-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 582.142700] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-729cf657-423a-44fc-a6a0-f7af5f1c8cd2 tempest-FloatingIPsAssociationTestJSON-1872521600 tempest-FloatingIPsAssociationTestJSON-1872521600-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 582.142878] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-729cf657-423a-44fc-a6a0-f7af5f1c8cd2 tempest-FloatingIPsAssociationTestJSON-1872521600 tempest-FloatingIPsAssociationTestJSON-1872521600-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 582.201309] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-729cf657-423a-44fc-a6a0-f7af5f1c8cd2 tempest-FloatingIPsAssociationTestJSON-1872521600 tempest-FloatingIPsAssociationTestJSON-1872521600-project-member] [instance: faa53e52-1d9a-4b4c-9841-d28728e49394] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 582.202223] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-729cf657-423a-44fc-a6a0-f7af5f1c8cd2 tempest-FloatingIPsAssociationTestJSON-1872521600 tempest-FloatingIPsAssociationTestJSON-1872521600-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 582.202562] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-729cf657-423a-44fc-a6a0-f7af5f1c8cd2 tempest-FloatingIPsAssociationTestJSON-1872521600 tempest-FloatingIPsAssociationTestJSON-1872521600-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 582.202795] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-729cf657-423a-44fc-a6a0-f7af5f1c8cd2 tempest-FloatingIPsAssociationTestJSON-1872521600 tempest-FloatingIPsAssociationTestJSON-1872521600-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 582.206750] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-729cf657-423a-44fc-a6a0-f7af5f1c8cd2 tempest-FloatingIPsAssociationTestJSON-1872521600 tempest-FloatingIPsAssociationTestJSON-1872521600-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 582.206750] nova-conductor[53001]: Traceback (most recent call last): [ 582.206750] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 582.206750] nova-conductor[53001]: return func(*args, **kwargs) [ 582.206750] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 582.206750] nova-conductor[53001]: selections = self._select_destinations( [ 582.206750] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 582.206750] nova-conductor[53001]: selections = self._schedule( [ 582.206750] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 582.206750] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 582.206750] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 582.206750] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 582.206750] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 582.206750] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 582.207817] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-729cf657-423a-44fc-a6a0-f7af5f1c8cd2 tempest-FloatingIPsAssociationTestJSON-1872521600 tempest-FloatingIPsAssociationTestJSON-1872521600-project-member] [instance: faa53e52-1d9a-4b4c-9841-d28728e49394] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 585.947102] nova-conductor[53002]: ERROR nova.conductor.manager [None req-5a55ac94-6e56-4f05-8e92-524126a1f220 tempest-InstanceActionsNegativeTestJSON-461934438 tempest-InstanceActionsNegativeTestJSON-461934438-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 585.947102] nova-conductor[53002]: Traceback (most recent call last): [ 585.947102] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 585.947102] nova-conductor[53002]: return func(*args, **kwargs) [ 585.947102] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 585.947102] nova-conductor[53002]: selections = self._select_destinations( [ 585.947102] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 585.947102] nova-conductor[53002]: selections = self._schedule( [ 585.947102] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 585.947102] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 585.947102] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 585.947102] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 585.947102] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 585.947102] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 585.947102] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 585.947102] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 585.947102] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 585.947102] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 585.947102] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 585.947102] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 585.947881] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 585.947881] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 585.947881] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 585.947881] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 585.947881] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 585.947881] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 585.947881] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 585.947881] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 585.947881] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 585.947881] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 585.947881] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 585.947881] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 585.947881] nova-conductor[53002]: ERROR nova.conductor.manager [ 585.947881] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 585.947881] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 585.947881] nova-conductor[53002]: ERROR nova.conductor.manager [ 585.947881] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 585.947881] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 585.947881] nova-conductor[53002]: ERROR nova.conductor.manager [ 585.948447] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 585.948447] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 585.948447] nova-conductor[53002]: ERROR nova.conductor.manager [ 585.948447] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 585.948447] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 585.948447] nova-conductor[53002]: ERROR nova.conductor.manager [ 585.948447] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 585.948447] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 585.948447] nova-conductor[53002]: ERROR nova.conductor.manager [ 585.948447] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 585.948447] nova-conductor[53002]: ERROR nova.conductor.manager [ 585.948447] nova-conductor[53002]: ERROR nova.conductor.manager [ 585.959467] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-5a55ac94-6e56-4f05-8e92-524126a1f220 tempest-InstanceActionsNegativeTestJSON-461934438 tempest-InstanceActionsNegativeTestJSON-461934438-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 585.960587] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-5a55ac94-6e56-4f05-8e92-524126a1f220 tempest-InstanceActionsNegativeTestJSON-461934438 tempest-InstanceActionsNegativeTestJSON-461934438-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 585.960587] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-5a55ac94-6e56-4f05-8e92-524126a1f220 tempest-InstanceActionsNegativeTestJSON-461934438 tempest-InstanceActionsNegativeTestJSON-461934438-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 586.029285] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-5a55ac94-6e56-4f05-8e92-524126a1f220 tempest-InstanceActionsNegativeTestJSON-461934438 tempest-InstanceActionsNegativeTestJSON-461934438-project-member] [instance: c4f38ae4-4dd2-4868-9bde-87f0365a5e4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 586.033159] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-5a55ac94-6e56-4f05-8e92-524126a1f220 tempest-InstanceActionsNegativeTestJSON-461934438 tempest-InstanceActionsNegativeTestJSON-461934438-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 586.033159] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-5a55ac94-6e56-4f05-8e92-524126a1f220 tempest-InstanceActionsNegativeTestJSON-461934438 tempest-InstanceActionsNegativeTestJSON-461934438-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 586.033159] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-5a55ac94-6e56-4f05-8e92-524126a1f220 tempest-InstanceActionsNegativeTestJSON-461934438 tempest-InstanceActionsNegativeTestJSON-461934438-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 586.038790] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-5a55ac94-6e56-4f05-8e92-524126a1f220 tempest-InstanceActionsNegativeTestJSON-461934438 tempest-InstanceActionsNegativeTestJSON-461934438-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 586.038790] nova-conductor[53002]: Traceback (most recent call last): [ 586.038790] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 586.038790] nova-conductor[53002]: return func(*args, **kwargs) [ 586.038790] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 586.038790] nova-conductor[53002]: selections = self._select_destinations( [ 586.038790] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 586.038790] nova-conductor[53002]: selections = self._schedule( [ 586.038790] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 586.038790] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 586.038790] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 586.038790] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 586.038790] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 586.038790] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 586.040166] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-5a55ac94-6e56-4f05-8e92-524126a1f220 tempest-InstanceActionsNegativeTestJSON-461934438 tempest-InstanceActionsNegativeTestJSON-461934438-project-member] [instance: c4f38ae4-4dd2-4868-9bde-87f0365a5e4f] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 586.686221] nova-conductor[53001]: ERROR nova.conductor.manager [None req-0172a13f-97b1-4d7f-961c-f3faf37831a3 tempest-VolumesAssistedSnapshotsTest-19524967 tempest-VolumesAssistedSnapshotsTest-19524967-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 586.686221] nova-conductor[53001]: Traceback (most recent call last): [ 586.686221] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 586.686221] nova-conductor[53001]: return func(*args, **kwargs) [ 586.686221] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 586.686221] nova-conductor[53001]: selections = self._select_destinations( [ 586.686221] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 586.686221] nova-conductor[53001]: selections = self._schedule( [ 586.686221] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 586.686221] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 586.686221] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 586.686221] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 586.686221] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 586.686221] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 586.686221] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 586.686221] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 586.686221] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 586.686221] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 586.686221] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 586.686221] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 586.686221] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 586.686970] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 586.686970] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 586.686970] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 586.686970] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 586.686970] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 586.686970] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 586.686970] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 586.686970] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 586.686970] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 586.686970] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 586.686970] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 586.686970] nova-conductor[53001]: ERROR nova.conductor.manager [ 586.686970] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 586.686970] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 586.686970] nova-conductor[53001]: ERROR nova.conductor.manager [ 586.686970] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 586.686970] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 586.686970] nova-conductor[53001]: ERROR nova.conductor.manager [ 586.686970] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 586.686970] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 586.686970] nova-conductor[53001]: ERROR nova.conductor.manager [ 586.687499] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 586.687499] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 586.687499] nova-conductor[53001]: ERROR nova.conductor.manager [ 586.687499] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 586.687499] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 586.687499] nova-conductor[53001]: ERROR nova.conductor.manager [ 586.687499] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 586.687499] nova-conductor[53001]: ERROR nova.conductor.manager [ 586.687499] nova-conductor[53001]: ERROR nova.conductor.manager [ 586.697934] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0172a13f-97b1-4d7f-961c-f3faf37831a3 tempest-VolumesAssistedSnapshotsTest-19524967 tempest-VolumesAssistedSnapshotsTest-19524967-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 586.698344] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0172a13f-97b1-4d7f-961c-f3faf37831a3 tempest-VolumesAssistedSnapshotsTest-19524967 tempest-VolumesAssistedSnapshotsTest-19524967-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 586.698676] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0172a13f-97b1-4d7f-961c-f3faf37831a3 tempest-VolumesAssistedSnapshotsTest-19524967 tempest-VolumesAssistedSnapshotsTest-19524967-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 586.795461] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-0172a13f-97b1-4d7f-961c-f3faf37831a3 tempest-VolumesAssistedSnapshotsTest-19524967 tempest-VolumesAssistedSnapshotsTest-19524967-project-member] [instance: 833e470f-8893-44e6-88dd-104307ba430a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 586.796229] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0172a13f-97b1-4d7f-961c-f3faf37831a3 tempest-VolumesAssistedSnapshotsTest-19524967 tempest-VolumesAssistedSnapshotsTest-19524967-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 586.796452] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0172a13f-97b1-4d7f-961c-f3faf37831a3 tempest-VolumesAssistedSnapshotsTest-19524967 tempest-VolumesAssistedSnapshotsTest-19524967-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 586.800482] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0172a13f-97b1-4d7f-961c-f3faf37831a3 tempest-VolumesAssistedSnapshotsTest-19524967 tempest-VolumesAssistedSnapshotsTest-19524967-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 586.803714] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-0172a13f-97b1-4d7f-961c-f3faf37831a3 tempest-VolumesAssistedSnapshotsTest-19524967 tempest-VolumesAssistedSnapshotsTest-19524967-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 586.803714] nova-conductor[53001]: Traceback (most recent call last): [ 586.803714] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 586.803714] nova-conductor[53001]: return func(*args, **kwargs) [ 586.803714] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 586.803714] nova-conductor[53001]: selections = self._select_destinations( [ 586.803714] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 586.803714] nova-conductor[53001]: selections = self._schedule( [ 586.803714] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 586.803714] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 586.803714] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 586.803714] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 586.803714] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 586.803714] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 586.804632] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-0172a13f-97b1-4d7f-961c-f3faf37831a3 tempest-VolumesAssistedSnapshotsTest-19524967 tempest-VolumesAssistedSnapshotsTest-19524967-project-member] [instance: 833e470f-8893-44e6-88dd-104307ba430a] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 587.689601] nova-conductor[53002]: ERROR nova.conductor.manager [None req-57230f47-2dcb-4efa-bb6d-e94b3bfe10e6 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 587.689601] nova-conductor[53002]: Traceback (most recent call last): [ 587.689601] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 587.689601] nova-conductor[53002]: return func(*args, **kwargs) [ 587.689601] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 587.689601] nova-conductor[53002]: selections = self._select_destinations( [ 587.689601] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 587.689601] nova-conductor[53002]: selections = self._schedule( [ 587.689601] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 587.689601] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 587.689601] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 587.689601] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 587.689601] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 587.689601] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 587.689601] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 587.689601] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 587.689601] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 587.689601] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 587.689601] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 587.689601] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 587.689601] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 587.690459] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 587.690459] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 587.690459] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 587.690459] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 587.690459] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 587.690459] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 587.690459] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 587.690459] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 587.690459] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 587.690459] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 587.690459] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 587.690459] nova-conductor[53002]: ERROR nova.conductor.manager [ 587.690459] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 587.690459] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 587.690459] nova-conductor[53002]: ERROR nova.conductor.manager [ 587.690459] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 587.690459] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 587.690459] nova-conductor[53002]: ERROR nova.conductor.manager [ 587.690459] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 587.690459] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 587.690459] nova-conductor[53002]: ERROR nova.conductor.manager [ 587.691056] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 587.691056] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 587.691056] nova-conductor[53002]: ERROR nova.conductor.manager [ 587.691056] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 587.691056] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 587.691056] nova-conductor[53002]: ERROR nova.conductor.manager [ 587.691056] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 587.691056] nova-conductor[53002]: ERROR nova.conductor.manager [ 587.691056] nova-conductor[53002]: ERROR nova.conductor.manager [ 587.706591] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-57230f47-2dcb-4efa-bb6d-e94b3bfe10e6 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 587.707969] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-57230f47-2dcb-4efa-bb6d-e94b3bfe10e6 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 587.707969] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-57230f47-2dcb-4efa-bb6d-e94b3bfe10e6 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 587.778029] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-57230f47-2dcb-4efa-bb6d-e94b3bfe10e6 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] [instance: 16bf75e7-73bd-4f57-ba78-3dc572b28ea6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 587.778738] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-57230f47-2dcb-4efa-bb6d-e94b3bfe10e6 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 587.779282] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-57230f47-2dcb-4efa-bb6d-e94b3bfe10e6 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 587.779529] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-57230f47-2dcb-4efa-bb6d-e94b3bfe10e6 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 587.783662] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-57230f47-2dcb-4efa-bb6d-e94b3bfe10e6 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 587.783662] nova-conductor[53002]: Traceback (most recent call last): [ 587.783662] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 587.783662] nova-conductor[53002]: return func(*args, **kwargs) [ 587.783662] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 587.783662] nova-conductor[53002]: selections = self._select_destinations( [ 587.783662] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 587.783662] nova-conductor[53002]: selections = self._schedule( [ 587.783662] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 587.783662] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 587.783662] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 587.783662] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 587.783662] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 587.783662] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 587.784234] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-57230f47-2dcb-4efa-bb6d-e94b3bfe10e6 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] [instance: 16bf75e7-73bd-4f57-ba78-3dc572b28ea6] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 589.914976] nova-conductor[53001]: ERROR nova.conductor.manager [None req-11c76021-6be7-42bd-b717-c7e1192a1f41 tempest-FloatingIPsAssociationNegativeTestJSON-443125163 tempest-FloatingIPsAssociationNegativeTestJSON-443125163-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 589.914976] nova-conductor[53001]: Traceback (most recent call last): [ 589.914976] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 589.914976] nova-conductor[53001]: return func(*args, **kwargs) [ 589.914976] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 589.914976] nova-conductor[53001]: selections = self._select_destinations( [ 589.914976] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 589.914976] nova-conductor[53001]: selections = self._schedule( [ 589.914976] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 589.914976] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 589.914976] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 589.914976] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 589.914976] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 589.914976] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 589.914976] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 589.914976] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 589.914976] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 589.914976] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 589.914976] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 589.914976] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 589.916041] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 589.916041] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 589.916041] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 589.916041] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 589.916041] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 589.916041] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 589.916041] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 589.916041] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 589.916041] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 589.916041] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 589.916041] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 589.916041] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 589.916041] nova-conductor[53001]: ERROR nova.conductor.manager [ 589.916041] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 589.916041] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 589.916041] nova-conductor[53001]: ERROR nova.conductor.manager [ 589.916041] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 589.916041] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 589.916041] nova-conductor[53001]: ERROR nova.conductor.manager [ 589.916843] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 589.916843] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 589.916843] nova-conductor[53001]: ERROR nova.conductor.manager [ 589.916843] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 589.916843] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 589.916843] nova-conductor[53001]: ERROR nova.conductor.manager [ 589.916843] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 589.916843] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 589.916843] nova-conductor[53001]: ERROR nova.conductor.manager [ 589.916843] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 589.916843] nova-conductor[53001]: ERROR nova.conductor.manager [ 589.916843] nova-conductor[53001]: ERROR nova.conductor.manager [ 589.926266] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-11c76021-6be7-42bd-b717-c7e1192a1f41 tempest-FloatingIPsAssociationNegativeTestJSON-443125163 tempest-FloatingIPsAssociationNegativeTestJSON-443125163-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 589.929032] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-11c76021-6be7-42bd-b717-c7e1192a1f41 tempest-FloatingIPsAssociationNegativeTestJSON-443125163 tempest-FloatingIPsAssociationNegativeTestJSON-443125163-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 589.929032] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-11c76021-6be7-42bd-b717-c7e1192a1f41 tempest-FloatingIPsAssociationNegativeTestJSON-443125163 tempest-FloatingIPsAssociationNegativeTestJSON-443125163-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 589.979112] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-11c76021-6be7-42bd-b717-c7e1192a1f41 tempest-FloatingIPsAssociationNegativeTestJSON-443125163 tempest-FloatingIPsAssociationNegativeTestJSON-443125163-project-member] [instance: cf1588aa-8049-471e-baa3-f57992edf320] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 589.980232] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-11c76021-6be7-42bd-b717-c7e1192a1f41 tempest-FloatingIPsAssociationNegativeTestJSON-443125163 tempest-FloatingIPsAssociationNegativeTestJSON-443125163-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 589.980476] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-11c76021-6be7-42bd-b717-c7e1192a1f41 tempest-FloatingIPsAssociationNegativeTestJSON-443125163 tempest-FloatingIPsAssociationNegativeTestJSON-443125163-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 589.980760] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-11c76021-6be7-42bd-b717-c7e1192a1f41 tempest-FloatingIPsAssociationNegativeTestJSON-443125163 tempest-FloatingIPsAssociationNegativeTestJSON-443125163-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 589.985227] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-11c76021-6be7-42bd-b717-c7e1192a1f41 tempest-FloatingIPsAssociationNegativeTestJSON-443125163 tempest-FloatingIPsAssociationNegativeTestJSON-443125163-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 589.985227] nova-conductor[53001]: Traceback (most recent call last): [ 589.985227] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 589.985227] nova-conductor[53001]: return func(*args, **kwargs) [ 589.985227] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 589.985227] nova-conductor[53001]: selections = self._select_destinations( [ 589.985227] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 589.985227] nova-conductor[53001]: selections = self._schedule( [ 589.985227] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 589.985227] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 589.985227] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 589.985227] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 589.985227] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 589.985227] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 589.985227] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-11c76021-6be7-42bd-b717-c7e1192a1f41 tempest-FloatingIPsAssociationNegativeTestJSON-443125163 tempest-FloatingIPsAssociationNegativeTestJSON-443125163-project-member] [instance: cf1588aa-8049-471e-baa3-f57992edf320] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 591.505207] nova-conductor[53001]: ERROR nova.conductor.manager [None req-706c65bb-d9d2-4dad-afe1-00e45eb06e41 tempest-ServersAdminTestJSON-2109170195 tempest-ServersAdminTestJSON-2109170195-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 591.505207] nova-conductor[53001]: Traceback (most recent call last): [ 591.505207] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 591.505207] nova-conductor[53001]: return func(*args, **kwargs) [ 591.505207] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 591.505207] nova-conductor[53001]: selections = self._select_destinations( [ 591.505207] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 591.505207] nova-conductor[53001]: selections = self._schedule( [ 591.505207] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 591.505207] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 591.505207] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 591.505207] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 591.505207] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 591.505207] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 591.505207] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 591.505207] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 591.505207] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 591.505207] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 591.505207] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 591.505207] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 591.505207] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 591.505990] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 591.505990] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 591.505990] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 591.505990] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 591.505990] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 591.505990] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 591.505990] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 591.505990] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 591.505990] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 591.505990] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 591.505990] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 591.505990] nova-conductor[53001]: ERROR nova.conductor.manager [ 591.505990] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 591.505990] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 591.505990] nova-conductor[53001]: ERROR nova.conductor.manager [ 591.505990] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 591.505990] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 591.505990] nova-conductor[53001]: ERROR nova.conductor.manager [ 591.505990] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 591.505990] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 591.505990] nova-conductor[53001]: ERROR nova.conductor.manager [ 591.509990] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 591.509990] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 591.509990] nova-conductor[53001]: ERROR nova.conductor.manager [ 591.509990] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 591.509990] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 591.509990] nova-conductor[53001]: ERROR nova.conductor.manager [ 591.509990] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 591.509990] nova-conductor[53001]: ERROR nova.conductor.manager [ 591.509990] nova-conductor[53001]: ERROR nova.conductor.manager [ 591.517494] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-706c65bb-d9d2-4dad-afe1-00e45eb06e41 tempest-ServersAdminTestJSON-2109170195 tempest-ServersAdminTestJSON-2109170195-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 591.517494] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-706c65bb-d9d2-4dad-afe1-00e45eb06e41 tempest-ServersAdminTestJSON-2109170195 tempest-ServersAdminTestJSON-2109170195-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 591.517494] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-706c65bb-d9d2-4dad-afe1-00e45eb06e41 tempest-ServersAdminTestJSON-2109170195 tempest-ServersAdminTestJSON-2109170195-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 591.529688] nova-conductor[53002]: ERROR nova.conductor.manager [None req-815dc034-ae8b-4687-8bd9-38de82f6d238 tempest-AttachInterfacesV270Test-597306843 tempest-AttachInterfacesV270Test-597306843-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 591.529688] nova-conductor[53002]: Traceback (most recent call last): [ 591.529688] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 591.529688] nova-conductor[53002]: return func(*args, **kwargs) [ 591.529688] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 591.529688] nova-conductor[53002]: selections = self._select_destinations( [ 591.529688] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 591.529688] nova-conductor[53002]: selections = self._schedule( [ 591.529688] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 591.529688] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 591.529688] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 591.529688] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 591.529688] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 591.529688] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 591.529688] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 591.529688] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 591.529688] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 591.529688] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 591.529688] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 591.529688] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 591.529688] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 591.530445] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 591.530445] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 591.530445] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 591.530445] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 591.530445] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 591.530445] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 591.530445] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 591.530445] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 591.530445] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 591.530445] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 591.530445] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 591.530445] nova-conductor[53002]: ERROR nova.conductor.manager [ 591.530445] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 591.530445] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 591.530445] nova-conductor[53002]: ERROR nova.conductor.manager [ 591.530445] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 591.530445] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 591.530445] nova-conductor[53002]: ERROR nova.conductor.manager [ 591.530445] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 591.530445] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 591.530445] nova-conductor[53002]: ERROR nova.conductor.manager [ 591.531050] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 591.531050] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 591.531050] nova-conductor[53002]: ERROR nova.conductor.manager [ 591.531050] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 591.531050] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 591.531050] nova-conductor[53002]: ERROR nova.conductor.manager [ 591.531050] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 591.531050] nova-conductor[53002]: ERROR nova.conductor.manager [ 591.531050] nova-conductor[53002]: ERROR nova.conductor.manager [ 591.537772] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-815dc034-ae8b-4687-8bd9-38de82f6d238 tempest-AttachInterfacesV270Test-597306843 tempest-AttachInterfacesV270Test-597306843-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 591.539018] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-815dc034-ae8b-4687-8bd9-38de82f6d238 tempest-AttachInterfacesV270Test-597306843 tempest-AttachInterfacesV270Test-597306843-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 591.539018] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-815dc034-ae8b-4687-8bd9-38de82f6d238 tempest-AttachInterfacesV270Test-597306843 tempest-AttachInterfacesV270Test-597306843-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 591.573457] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-706c65bb-d9d2-4dad-afe1-00e45eb06e41 tempest-ServersAdminTestJSON-2109170195 tempest-ServersAdminTestJSON-2109170195-project-member] [instance: daee27c3-7e1f-47cc-b143-e1361c3f8527] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 591.574204] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-706c65bb-d9d2-4dad-afe1-00e45eb06e41 tempest-ServersAdminTestJSON-2109170195 tempest-ServersAdminTestJSON-2109170195-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 591.574446] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-706c65bb-d9d2-4dad-afe1-00e45eb06e41 tempest-ServersAdminTestJSON-2109170195 tempest-ServersAdminTestJSON-2109170195-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 591.574618] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-706c65bb-d9d2-4dad-afe1-00e45eb06e41 tempest-ServersAdminTestJSON-2109170195 tempest-ServersAdminTestJSON-2109170195-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 591.578409] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-706c65bb-d9d2-4dad-afe1-00e45eb06e41 tempest-ServersAdminTestJSON-2109170195 tempest-ServersAdminTestJSON-2109170195-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 591.578409] nova-conductor[53001]: Traceback (most recent call last): [ 591.578409] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 591.578409] nova-conductor[53001]: return func(*args, **kwargs) [ 591.578409] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 591.578409] nova-conductor[53001]: selections = self._select_destinations( [ 591.578409] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 591.578409] nova-conductor[53001]: selections = self._schedule( [ 591.578409] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 591.578409] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 591.578409] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 591.578409] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 591.578409] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 591.578409] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 591.579052] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-706c65bb-d9d2-4dad-afe1-00e45eb06e41 tempest-ServersAdminTestJSON-2109170195 tempest-ServersAdminTestJSON-2109170195-project-member] [instance: daee27c3-7e1f-47cc-b143-e1361c3f8527] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 591.596121] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-815dc034-ae8b-4687-8bd9-38de82f6d238 tempest-AttachInterfacesV270Test-597306843 tempest-AttachInterfacesV270Test-597306843-project-member] [instance: abe82cc4-1648-4372-bc5e-899c315e9fff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 591.596121] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-815dc034-ae8b-4687-8bd9-38de82f6d238 tempest-AttachInterfacesV270Test-597306843 tempest-AttachInterfacesV270Test-597306843-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 591.596121] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-815dc034-ae8b-4687-8bd9-38de82f6d238 tempest-AttachInterfacesV270Test-597306843 tempest-AttachInterfacesV270Test-597306843-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 591.596410] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-815dc034-ae8b-4687-8bd9-38de82f6d238 tempest-AttachInterfacesV270Test-597306843 tempest-AttachInterfacesV270Test-597306843-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 591.598641] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-815dc034-ae8b-4687-8bd9-38de82f6d238 tempest-AttachInterfacesV270Test-597306843 tempest-AttachInterfacesV270Test-597306843-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 591.598641] nova-conductor[53002]: Traceback (most recent call last): [ 591.598641] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 591.598641] nova-conductor[53002]: return func(*args, **kwargs) [ 591.598641] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 591.598641] nova-conductor[53002]: selections = self._select_destinations( [ 591.598641] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 591.598641] nova-conductor[53002]: selections = self._schedule( [ 591.598641] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 591.598641] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 591.598641] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 591.598641] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 591.598641] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 591.598641] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 591.599481] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-815dc034-ae8b-4687-8bd9-38de82f6d238 tempest-AttachInterfacesV270Test-597306843 tempest-AttachInterfacesV270Test-597306843-project-member] [instance: abe82cc4-1648-4372-bc5e-899c315e9fff] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 592.605075] nova-conductor[53002]: ERROR nova.conductor.manager [None req-3e9115d3-4b40-4a2d-bc88-6c127d23286b tempest-ServerAddressesTestJSON-1691284034 tempest-ServerAddressesTestJSON-1691284034-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 592.605075] nova-conductor[53002]: Traceback (most recent call last): [ 592.605075] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 592.605075] nova-conductor[53002]: return func(*args, **kwargs) [ 592.605075] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 592.605075] nova-conductor[53002]: selections = self._select_destinations( [ 592.605075] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 592.605075] nova-conductor[53002]: selections = self._schedule( [ 592.605075] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 592.605075] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 592.605075] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 592.605075] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 592.605075] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 592.605075] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 592.605075] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 592.605075] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 592.605075] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 592.605075] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 592.605075] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 592.605075] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 592.605075] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 592.605856] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 592.605856] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 592.605856] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 592.605856] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 592.605856] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 592.605856] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 592.605856] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 592.605856] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 592.605856] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 592.605856] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 592.605856] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 592.605856] nova-conductor[53002]: ERROR nova.conductor.manager [ 592.605856] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 592.605856] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 592.605856] nova-conductor[53002]: ERROR nova.conductor.manager [ 592.605856] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 592.605856] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 592.605856] nova-conductor[53002]: ERROR nova.conductor.manager [ 592.605856] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 592.605856] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 592.605856] nova-conductor[53002]: ERROR nova.conductor.manager [ 592.606578] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 592.606578] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 592.606578] nova-conductor[53002]: ERROR nova.conductor.manager [ 592.606578] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 592.606578] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 592.606578] nova-conductor[53002]: ERROR nova.conductor.manager [ 592.606578] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 592.606578] nova-conductor[53002]: ERROR nova.conductor.manager [ 592.606578] nova-conductor[53002]: ERROR nova.conductor.manager [ 592.613451] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-3e9115d3-4b40-4a2d-bc88-6c127d23286b tempest-ServerAddressesTestJSON-1691284034 tempest-ServerAddressesTestJSON-1691284034-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 592.613540] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-3e9115d3-4b40-4a2d-bc88-6c127d23286b tempest-ServerAddressesTestJSON-1691284034 tempest-ServerAddressesTestJSON-1691284034-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 592.613661] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-3e9115d3-4b40-4a2d-bc88-6c127d23286b tempest-ServerAddressesTestJSON-1691284034 tempest-ServerAddressesTestJSON-1691284034-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 592.620548] nova-conductor[53001]: ERROR nova.conductor.manager [None req-6b08b4f7-3345-483c-90dc-5262562c8b08 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 592.620548] nova-conductor[53001]: Traceback (most recent call last): [ 592.620548] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 592.620548] nova-conductor[53001]: return func(*args, **kwargs) [ 592.620548] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 592.620548] nova-conductor[53001]: selections = self._select_destinations( [ 592.620548] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 592.620548] nova-conductor[53001]: selections = self._schedule( [ 592.620548] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 592.620548] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 592.620548] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 592.620548] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 592.620548] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 592.620548] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 592.620548] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 592.620548] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 592.620548] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 592.620548] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 592.620548] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 592.620548] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 592.620548] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 592.621295] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 592.621295] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 592.621295] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 592.621295] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 592.621295] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 592.621295] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 592.621295] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 592.621295] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 592.621295] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 592.621295] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 592.621295] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 592.621295] nova-conductor[53001]: ERROR nova.conductor.manager [ 592.621295] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 592.621295] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 592.621295] nova-conductor[53001]: ERROR nova.conductor.manager [ 592.621295] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 592.621295] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 592.621295] nova-conductor[53001]: ERROR nova.conductor.manager [ 592.621295] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 592.621295] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 592.621295] nova-conductor[53001]: ERROR nova.conductor.manager [ 592.621821] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 592.621821] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 592.621821] nova-conductor[53001]: ERROR nova.conductor.manager [ 592.621821] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 592.621821] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 592.621821] nova-conductor[53001]: ERROR nova.conductor.manager [ 592.621821] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 592.621821] nova-conductor[53001]: ERROR nova.conductor.manager [ 592.621821] nova-conductor[53001]: ERROR nova.conductor.manager [ 592.630751] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-6b08b4f7-3345-483c-90dc-5262562c8b08 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 592.632460] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-6b08b4f7-3345-483c-90dc-5262562c8b08 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 592.632844] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-6b08b4f7-3345-483c-90dc-5262562c8b08 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 592.665205] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-3e9115d3-4b40-4a2d-bc88-6c127d23286b tempest-ServerAddressesTestJSON-1691284034 tempest-ServerAddressesTestJSON-1691284034-project-member] [instance: 1c64f49e-c014-42e1-9529-98151229cd38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 592.665959] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-3e9115d3-4b40-4a2d-bc88-6c127d23286b tempest-ServerAddressesTestJSON-1691284034 tempest-ServerAddressesTestJSON-1691284034-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 592.667098] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-3e9115d3-4b40-4a2d-bc88-6c127d23286b tempest-ServerAddressesTestJSON-1691284034 tempest-ServerAddressesTestJSON-1691284034-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 592.667098] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-3e9115d3-4b40-4a2d-bc88-6c127d23286b tempest-ServerAddressesTestJSON-1691284034 tempest-ServerAddressesTestJSON-1691284034-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 592.671809] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-3e9115d3-4b40-4a2d-bc88-6c127d23286b tempest-ServerAddressesTestJSON-1691284034 tempest-ServerAddressesTestJSON-1691284034-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 592.671809] nova-conductor[53002]: Traceback (most recent call last): [ 592.671809] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 592.671809] nova-conductor[53002]: return func(*args, **kwargs) [ 592.671809] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 592.671809] nova-conductor[53002]: selections = self._select_destinations( [ 592.671809] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 592.671809] nova-conductor[53002]: selections = self._schedule( [ 592.671809] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 592.671809] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 592.671809] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 592.671809] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 592.671809] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 592.671809] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 592.672328] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-3e9115d3-4b40-4a2d-bc88-6c127d23286b tempest-ServerAddressesTestJSON-1691284034 tempest-ServerAddressesTestJSON-1691284034-project-member] [instance: 1c64f49e-c014-42e1-9529-98151229cd38] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 592.687110] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-6b08b4f7-3345-483c-90dc-5262562c8b08 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] [instance: a4a79655-c467-4de8-8441-fe24b89aab39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 592.687811] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-6b08b4f7-3345-483c-90dc-5262562c8b08 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 592.688242] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-6b08b4f7-3345-483c-90dc-5262562c8b08 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 592.688242] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-6b08b4f7-3345-483c-90dc-5262562c8b08 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 592.693415] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-6b08b4f7-3345-483c-90dc-5262562c8b08 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 592.693415] nova-conductor[53001]: Traceback (most recent call last): [ 592.693415] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 592.693415] nova-conductor[53001]: return func(*args, **kwargs) [ 592.693415] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 592.693415] nova-conductor[53001]: selections = self._select_destinations( [ 592.693415] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 592.693415] nova-conductor[53001]: selections = self._schedule( [ 592.693415] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 592.693415] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 592.693415] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 592.693415] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 592.693415] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 592.693415] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 592.694369] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-6b08b4f7-3345-483c-90dc-5262562c8b08 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] [instance: a4a79655-c467-4de8-8441-fe24b89aab39] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 593.385359] nova-conductor[53002]: ERROR nova.conductor.manager [None req-fa46b43f-cb42-47e4-af6a-9d6cbc422d0e tempest-InstanceActionsTestJSON-653494893 tempest-InstanceActionsTestJSON-653494893-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 593.385359] nova-conductor[53002]: Traceback (most recent call last): [ 593.385359] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 593.385359] nova-conductor[53002]: return func(*args, **kwargs) [ 593.385359] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 593.385359] nova-conductor[53002]: selections = self._select_destinations( [ 593.385359] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 593.385359] nova-conductor[53002]: selections = self._schedule( [ 593.385359] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 593.385359] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 593.385359] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 593.385359] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 593.385359] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 593.385359] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 593.385359] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 593.385359] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 593.385359] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 593.385359] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 593.385359] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 593.385359] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 593.385359] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 593.386290] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 593.386290] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 593.386290] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 593.386290] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 593.386290] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 593.386290] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 593.386290] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 593.386290] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 593.386290] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 593.386290] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 593.386290] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 593.386290] nova-conductor[53002]: ERROR nova.conductor.manager [ 593.386290] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 593.386290] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 593.386290] nova-conductor[53002]: ERROR nova.conductor.manager [ 593.386290] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 593.386290] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 593.386290] nova-conductor[53002]: ERROR nova.conductor.manager [ 593.386290] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 593.386290] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 593.386290] nova-conductor[53002]: ERROR nova.conductor.manager [ 593.387119] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 593.387119] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 593.387119] nova-conductor[53002]: ERROR nova.conductor.manager [ 593.387119] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 593.387119] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 593.387119] nova-conductor[53002]: ERROR nova.conductor.manager [ 593.387119] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 593.387119] nova-conductor[53002]: ERROR nova.conductor.manager [ 593.387119] nova-conductor[53002]: ERROR nova.conductor.manager [ 593.393271] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-fa46b43f-cb42-47e4-af6a-9d6cbc422d0e tempest-InstanceActionsTestJSON-653494893 tempest-InstanceActionsTestJSON-653494893-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 593.393518] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-fa46b43f-cb42-47e4-af6a-9d6cbc422d0e tempest-InstanceActionsTestJSON-653494893 tempest-InstanceActionsTestJSON-653494893-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 593.393691] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-fa46b43f-cb42-47e4-af6a-9d6cbc422d0e tempest-InstanceActionsTestJSON-653494893 tempest-InstanceActionsTestJSON-653494893-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 593.450436] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-fa46b43f-cb42-47e4-af6a-9d6cbc422d0e tempest-InstanceActionsTestJSON-653494893 tempest-InstanceActionsTestJSON-653494893-project-member] [instance: b7a1b58d-a07a-46cb-a35c-dbfdcaa70a9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 593.452114] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-fa46b43f-cb42-47e4-af6a-9d6cbc422d0e tempest-InstanceActionsTestJSON-653494893 tempest-InstanceActionsTestJSON-653494893-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 593.452431] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-fa46b43f-cb42-47e4-af6a-9d6cbc422d0e tempest-InstanceActionsTestJSON-653494893 tempest-InstanceActionsTestJSON-653494893-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 593.452906] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-fa46b43f-cb42-47e4-af6a-9d6cbc422d0e tempest-InstanceActionsTestJSON-653494893 tempest-InstanceActionsTestJSON-653494893-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 593.458459] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-fa46b43f-cb42-47e4-af6a-9d6cbc422d0e tempest-InstanceActionsTestJSON-653494893 tempest-InstanceActionsTestJSON-653494893-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 593.458459] nova-conductor[53002]: Traceback (most recent call last): [ 593.458459] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 593.458459] nova-conductor[53002]: return func(*args, **kwargs) [ 593.458459] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 593.458459] nova-conductor[53002]: selections = self._select_destinations( [ 593.458459] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 593.458459] nova-conductor[53002]: selections = self._schedule( [ 593.458459] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 593.458459] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 593.458459] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 593.458459] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 593.458459] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 593.458459] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 593.459060] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-fa46b43f-cb42-47e4-af6a-9d6cbc422d0e tempest-InstanceActionsTestJSON-653494893 tempest-InstanceActionsTestJSON-653494893-project-member] [instance: b7a1b58d-a07a-46cb-a35c-dbfdcaa70a9c] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 594.616613] nova-conductor[53002]: ERROR nova.conductor.manager [None req-587028dc-dbcb-48b8-a20e-808a121ae16b tempest-ServersTestManualDisk-984746619 tempest-ServersTestManualDisk-984746619-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 594.616613] nova-conductor[53002]: Traceback (most recent call last): [ 594.616613] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 594.616613] nova-conductor[53002]: return func(*args, **kwargs) [ 594.616613] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 594.616613] nova-conductor[53002]: selections = self._select_destinations( [ 594.616613] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 594.616613] nova-conductor[53002]: selections = self._schedule( [ 594.616613] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 594.616613] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 594.616613] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 594.616613] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 594.616613] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 594.616613] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 594.616613] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 594.616613] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 594.616613] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 594.616613] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 594.616613] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 594.616613] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 594.616613] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 594.617407] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 594.617407] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 594.617407] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 594.617407] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 594.617407] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 594.617407] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 594.617407] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 594.617407] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 594.617407] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 594.617407] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 594.617407] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 594.617407] nova-conductor[53002]: ERROR nova.conductor.manager [ 594.617407] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 594.617407] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 594.617407] nova-conductor[53002]: ERROR nova.conductor.manager [ 594.617407] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 594.617407] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 594.617407] nova-conductor[53002]: ERROR nova.conductor.manager [ 594.617407] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 594.617407] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 594.617407] nova-conductor[53002]: ERROR nova.conductor.manager [ 594.618039] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 594.618039] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 594.618039] nova-conductor[53002]: ERROR nova.conductor.manager [ 594.618039] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 594.618039] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 594.618039] nova-conductor[53002]: ERROR nova.conductor.manager [ 594.618039] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 594.618039] nova-conductor[53002]: ERROR nova.conductor.manager [ 594.618039] nova-conductor[53002]: ERROR nova.conductor.manager [ 594.632715] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-587028dc-dbcb-48b8-a20e-808a121ae16b tempest-ServersTestManualDisk-984746619 tempest-ServersTestManualDisk-984746619-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 594.633173] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-587028dc-dbcb-48b8-a20e-808a121ae16b tempest-ServersTestManualDisk-984746619 tempest-ServersTestManualDisk-984746619-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 594.633450] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-587028dc-dbcb-48b8-a20e-808a121ae16b tempest-ServersTestManualDisk-984746619 tempest-ServersTestManualDisk-984746619-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 594.716118] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-587028dc-dbcb-48b8-a20e-808a121ae16b tempest-ServersTestManualDisk-984746619 tempest-ServersTestManualDisk-984746619-project-member] [instance: 6a6cd40b-0157-403d-b7db-38e04707fbf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 594.716957] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-587028dc-dbcb-48b8-a20e-808a121ae16b tempest-ServersTestManualDisk-984746619 tempest-ServersTestManualDisk-984746619-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 594.717543] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-587028dc-dbcb-48b8-a20e-808a121ae16b tempest-ServersTestManualDisk-984746619 tempest-ServersTestManualDisk-984746619-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 594.717814] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-587028dc-dbcb-48b8-a20e-808a121ae16b tempest-ServersTestManualDisk-984746619 tempest-ServersTestManualDisk-984746619-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 594.721846] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-587028dc-dbcb-48b8-a20e-808a121ae16b tempest-ServersTestManualDisk-984746619 tempest-ServersTestManualDisk-984746619-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 594.721846] nova-conductor[53002]: Traceback (most recent call last): [ 594.721846] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 594.721846] nova-conductor[53002]: return func(*args, **kwargs) [ 594.721846] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 594.721846] nova-conductor[53002]: selections = self._select_destinations( [ 594.721846] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 594.721846] nova-conductor[53002]: selections = self._schedule( [ 594.721846] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 594.721846] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 594.721846] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 594.721846] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 594.721846] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 594.721846] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 594.722624] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-587028dc-dbcb-48b8-a20e-808a121ae16b tempest-ServersTestManualDisk-984746619 tempest-ServersTestManualDisk-984746619-project-member] [instance: 6a6cd40b-0157-403d-b7db-38e04707fbf3] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 594.933020] nova-conductor[53001]: ERROR nova.conductor.manager [None req-f23a7b85-f7e4-46e2-a16e-833e001feb70 tempest-ServersAdminTestJSON-2109170195 tempest-ServersAdminTestJSON-2109170195-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 594.933020] nova-conductor[53001]: Traceback (most recent call last): [ 594.933020] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 594.933020] nova-conductor[53001]: return func(*args, **kwargs) [ 594.933020] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 594.933020] nova-conductor[53001]: selections = self._select_destinations( [ 594.933020] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 594.933020] nova-conductor[53001]: selections = self._schedule( [ 594.933020] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 594.933020] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 594.933020] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 594.933020] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 594.933020] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 594.933020] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 594.933020] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 594.933020] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 594.933020] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 594.933020] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 594.933020] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 594.933020] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 594.933020] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 594.933786] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 594.933786] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 594.933786] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 594.933786] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 594.933786] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 594.933786] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 594.933786] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 594.933786] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 594.933786] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 594.933786] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 594.933786] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 594.933786] nova-conductor[53001]: ERROR nova.conductor.manager [ 594.933786] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 594.933786] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 594.933786] nova-conductor[53001]: ERROR nova.conductor.manager [ 594.933786] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 594.933786] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 594.933786] nova-conductor[53001]: ERROR nova.conductor.manager [ 594.933786] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 594.933786] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 594.933786] nova-conductor[53001]: ERROR nova.conductor.manager [ 594.934385] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 594.934385] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 594.934385] nova-conductor[53001]: ERROR nova.conductor.manager [ 594.934385] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 594.934385] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 594.934385] nova-conductor[53001]: ERROR nova.conductor.manager [ 594.934385] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 594.934385] nova-conductor[53001]: ERROR nova.conductor.manager [ 594.934385] nova-conductor[53001]: ERROR nova.conductor.manager [ 594.944034] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f23a7b85-f7e4-46e2-a16e-833e001feb70 tempest-ServersAdminTestJSON-2109170195 tempest-ServersAdminTestJSON-2109170195-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 594.944034] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f23a7b85-f7e4-46e2-a16e-833e001feb70 tempest-ServersAdminTestJSON-2109170195 tempest-ServersAdminTestJSON-2109170195-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 594.944034] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f23a7b85-f7e4-46e2-a16e-833e001feb70 tempest-ServersAdminTestJSON-2109170195 tempest-ServersAdminTestJSON-2109170195-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 594.995039] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-f23a7b85-f7e4-46e2-a16e-833e001feb70 tempest-ServersAdminTestJSON-2109170195 tempest-ServersAdminTestJSON-2109170195-project-member] [instance: 3c1b98d0-69c5-4b2b-bea1-a047ecb7c47b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 594.995838] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f23a7b85-f7e4-46e2-a16e-833e001feb70 tempest-ServersAdminTestJSON-2109170195 tempest-ServersAdminTestJSON-2109170195-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 594.996108] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f23a7b85-f7e4-46e2-a16e-833e001feb70 tempest-ServersAdminTestJSON-2109170195 tempest-ServersAdminTestJSON-2109170195-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 594.996292] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f23a7b85-f7e4-46e2-a16e-833e001feb70 tempest-ServersAdminTestJSON-2109170195 tempest-ServersAdminTestJSON-2109170195-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 594.999857] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-f23a7b85-f7e4-46e2-a16e-833e001feb70 tempest-ServersAdminTestJSON-2109170195 tempest-ServersAdminTestJSON-2109170195-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 594.999857] nova-conductor[53001]: Traceback (most recent call last): [ 594.999857] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 594.999857] nova-conductor[53001]: return func(*args, **kwargs) [ 594.999857] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 594.999857] nova-conductor[53001]: selections = self._select_destinations( [ 594.999857] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 594.999857] nova-conductor[53001]: selections = self._schedule( [ 594.999857] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 594.999857] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 594.999857] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 594.999857] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 594.999857] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 594.999857] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 595.000465] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-f23a7b85-f7e4-46e2-a16e-833e001feb70 tempest-ServersAdminTestJSON-2109170195 tempest-ServersAdminTestJSON-2109170195-project-member] [instance: 3c1b98d0-69c5-4b2b-bea1-a047ecb7c47b] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 595.489035] nova-conductor[53002]: ERROR nova.conductor.manager [None req-c318284e-36ec-4ddf-9706-c01cfc6781c8 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 595.489035] nova-conductor[53002]: Traceback (most recent call last): [ 595.489035] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 595.489035] nova-conductor[53002]: return func(*args, **kwargs) [ 595.489035] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 595.489035] nova-conductor[53002]: selections = self._select_destinations( [ 595.489035] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 595.489035] nova-conductor[53002]: selections = self._schedule( [ 595.489035] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 595.489035] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 595.489035] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 595.489035] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 595.489035] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 595.489035] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 595.489035] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 595.489035] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 595.489035] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 595.489035] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 595.489035] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 595.489035] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 595.489035] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 595.489691] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 595.489691] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 595.489691] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 595.489691] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 595.489691] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 595.489691] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 595.489691] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 595.489691] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 595.489691] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 595.489691] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 595.489691] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 595.489691] nova-conductor[53002]: ERROR nova.conductor.manager [ 595.489691] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 595.489691] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 595.489691] nova-conductor[53002]: ERROR nova.conductor.manager [ 595.489691] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 595.489691] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 595.489691] nova-conductor[53002]: ERROR nova.conductor.manager [ 595.489691] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 595.489691] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 595.489691] nova-conductor[53002]: ERROR nova.conductor.manager [ 595.490373] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 595.490373] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 595.490373] nova-conductor[53002]: ERROR nova.conductor.manager [ 595.490373] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 595.490373] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 595.490373] nova-conductor[53002]: ERROR nova.conductor.manager [ 595.490373] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 595.490373] nova-conductor[53002]: ERROR nova.conductor.manager [ 595.490373] nova-conductor[53002]: ERROR nova.conductor.manager [ 595.498247] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c318284e-36ec-4ddf-9706-c01cfc6781c8 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 595.498584] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c318284e-36ec-4ddf-9706-c01cfc6781c8 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 595.498711] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c318284e-36ec-4ddf-9706-c01cfc6781c8 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 595.555937] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-c318284e-36ec-4ddf-9706-c01cfc6781c8 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] [instance: 2c86426a-8bb8-470f-a762-ec46506ebe80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 595.556707] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c318284e-36ec-4ddf-9706-c01cfc6781c8 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 595.556930] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c318284e-36ec-4ddf-9706-c01cfc6781c8 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 595.557115] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c318284e-36ec-4ddf-9706-c01cfc6781c8 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 595.566656] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-c318284e-36ec-4ddf-9706-c01cfc6781c8 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 595.566656] nova-conductor[53002]: Traceback (most recent call last): [ 595.566656] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 595.566656] nova-conductor[53002]: return func(*args, **kwargs) [ 595.566656] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 595.566656] nova-conductor[53002]: selections = self._select_destinations( [ 595.566656] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 595.566656] nova-conductor[53002]: selections = self._schedule( [ 595.566656] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 595.566656] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 595.566656] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 595.566656] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 595.566656] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 595.566656] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 595.566656] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-c318284e-36ec-4ddf-9706-c01cfc6781c8 tempest-ListServerFiltersTestJSON-1070008837 tempest-ListServerFiltersTestJSON-1070008837-project-member] [instance: 2c86426a-8bb8-470f-a762-ec46506ebe80] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 600.986740] nova-conductor[53002]: ERROR nova.conductor.manager [None req-861b027f-fd07-4df7-9c7f-7b4cf4c17923 tempest-MigrationsAdminTest-1918173476 tempest-MigrationsAdminTest-1918173476-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 600.986740] nova-conductor[53002]: Traceback (most recent call last): [ 600.986740] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 600.986740] nova-conductor[53002]: return func(*args, **kwargs) [ 600.986740] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 600.986740] nova-conductor[53002]: selections = self._select_destinations( [ 600.986740] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 600.986740] nova-conductor[53002]: selections = self._schedule( [ 600.986740] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 600.986740] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 600.986740] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 600.986740] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 600.986740] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 600.986740] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 600.986740] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 600.986740] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 600.986740] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 600.986740] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 600.986740] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 600.986740] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 600.986740] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 600.987676] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 600.987676] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 600.987676] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 600.987676] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 600.987676] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 600.987676] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 600.987676] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 600.987676] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 600.987676] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 600.987676] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 600.987676] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 600.987676] nova-conductor[53002]: ERROR nova.conductor.manager [ 600.987676] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 600.987676] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 600.987676] nova-conductor[53002]: ERROR nova.conductor.manager [ 600.987676] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 600.987676] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 600.987676] nova-conductor[53002]: ERROR nova.conductor.manager [ 600.987676] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 600.987676] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 600.987676] nova-conductor[53002]: ERROR nova.conductor.manager [ 600.988247] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 600.988247] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 600.988247] nova-conductor[53002]: ERROR nova.conductor.manager [ 600.988247] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 600.988247] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 600.988247] nova-conductor[53002]: ERROR nova.conductor.manager [ 600.988247] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 600.988247] nova-conductor[53002]: ERROR nova.conductor.manager [ 600.988247] nova-conductor[53002]: ERROR nova.conductor.manager [ 601.000730] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-861b027f-fd07-4df7-9c7f-7b4cf4c17923 tempest-MigrationsAdminTest-1918173476 tempest-MigrationsAdminTest-1918173476-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 601.000730] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-861b027f-fd07-4df7-9c7f-7b4cf4c17923 tempest-MigrationsAdminTest-1918173476 tempest-MigrationsAdminTest-1918173476-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 601.000900] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-861b027f-fd07-4df7-9c7f-7b4cf4c17923 tempest-MigrationsAdminTest-1918173476 tempest-MigrationsAdminTest-1918173476-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 601.064107] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-861b027f-fd07-4df7-9c7f-7b4cf4c17923 tempest-MigrationsAdminTest-1918173476 tempest-MigrationsAdminTest-1918173476-project-member] [instance: f40a697f-9ce4-4e79-8008-e4652b9d10f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 601.065061] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-861b027f-fd07-4df7-9c7f-7b4cf4c17923 tempest-MigrationsAdminTest-1918173476 tempest-MigrationsAdminTest-1918173476-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 601.065147] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-861b027f-fd07-4df7-9c7f-7b4cf4c17923 tempest-MigrationsAdminTest-1918173476 tempest-MigrationsAdminTest-1918173476-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 601.065305] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-861b027f-fd07-4df7-9c7f-7b4cf4c17923 tempest-MigrationsAdminTest-1918173476 tempest-MigrationsAdminTest-1918173476-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 601.068558] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-861b027f-fd07-4df7-9c7f-7b4cf4c17923 tempest-MigrationsAdminTest-1918173476 tempest-MigrationsAdminTest-1918173476-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 601.068558] nova-conductor[53002]: Traceback (most recent call last): [ 601.068558] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 601.068558] nova-conductor[53002]: return func(*args, **kwargs) [ 601.068558] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 601.068558] nova-conductor[53002]: selections = self._select_destinations( [ 601.068558] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 601.068558] nova-conductor[53002]: selections = self._schedule( [ 601.068558] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 601.068558] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 601.068558] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 601.068558] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 601.068558] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 601.068558] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 601.069481] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-861b027f-fd07-4df7-9c7f-7b4cf4c17923 tempest-MigrationsAdminTest-1918173476 tempest-MigrationsAdminTest-1918173476-project-member] [instance: f40a697f-9ce4-4e79-8008-e4652b9d10f9] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 614.899979] nova-conductor[53002]: ERROR nova.scheduler.utils [None req-cc008bbb-da29-413c-8d6f-cbe86f0a9d3f tempest-ServerDiagnosticsV248Test-603941409 tempest-ServerDiagnosticsV248Test-603941409-project-member] [instance: d76e8d11-53d3-417d-b6a6-08bdff8165d5] Error from last host: cpu-1 (node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28): ['Traceback (most recent call last):\n', ' File "/opt/stack/nova/nova/compute/manager.py", line 2611, in _build_and_run_instance\n self.driver.spawn(context, instance, image_meta,\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/driver.py", line 529, in spawn\n self._vmops.spawn(context, instance, image_meta, injected_files,\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 786, in spawn\n self._fetch_image_if_missing(context, vi)\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 639, in _fetch_image_if_missing\n image_cache(vi, tmp_image_ds_loc)\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 537, in _cache_sparse_image\n vm_util.copy_virtual_disk(\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vm_util.py", line 1423, in copy_virtual_disk\n session._wait_for_task(vmdk_copy_task)\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/session.py", line 157, in _wait_for_task\n return self.wait_for_task(task_ref)\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_vmware/api.py", line 398, in wait_for_task\n return evt.wait()\n', ' File "/usr/local/lib/python3.10/dist-packages/eventlet/event.py", line 125, in wait\n result = hub.switch()\n', ' File "/usr/local/lib/python3.10/dist-packages/eventlet/hubs/hub.py", line 313, in switch\n return self.greenlet.switch()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_vmware/common/loopingcall.py", line 75, in _inner\n self.f(*self.args, **self.kw)\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_vmware/api.py", line 448, in _poll_task\n raise exceptions.translate_fault(task_info.error)\n', "oslo_vmware.exceptions.VimFaultException: A specified parameter was not correct: fileType\nFaults: ['InvalidArgument']\n", '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', ' File "/opt/stack/nova/nova/compute/manager.py", line 2426, in _do_build_and_run_instance\n self._build_and_run_instance(context, instance, image,\n', ' File "/opt/stack/nova/nova/compute/manager.py", line 2718, in _build_and_run_instance\n raise exception.RescheduledException(\n', "nova.exception.RescheduledException: Build of instance d76e8d11-53d3-417d-b6a6-08bdff8165d5 was re-scheduled: A specified parameter was not correct: fileType\nFaults: ['InvalidArgument']\n"] [ 614.902728] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-cc008bbb-da29-413c-8d6f-cbe86f0a9d3f tempest-ServerDiagnosticsV248Test-603941409 tempest-ServerDiagnosticsV248Test-603941409-project-member] Rescheduling: True {{(pid=53002) build_instances /opt/stack/nova/nova/conductor/manager.py:695}} [ 614.903052] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-cc008bbb-da29-413c-8d6f-cbe86f0a9d3f tempest-ServerDiagnosticsV248Test-603941409 tempest-ServerDiagnosticsV248Test-603941409-project-member] Failed to compute_task_build_instances: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance d76e8d11-53d3-417d-b6a6-08bdff8165d5.: nova.exception.MaxRetriesExceeded: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance d76e8d11-53d3-417d-b6a6-08bdff8165d5. [ 614.903583] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-cc008bbb-da29-413c-8d6f-cbe86f0a9d3f tempest-ServerDiagnosticsV248Test-603941409 tempest-ServerDiagnosticsV248Test-603941409-project-member] [instance: d76e8d11-53d3-417d-b6a6-08bdff8165d5] Setting instance to ERROR state.: nova.exception.MaxRetriesExceeded: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance d76e8d11-53d3-417d-b6a6-08bdff8165d5. [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager [None req-be7753e5-1c95-41b5-bbdb-3962747da2e5 tempest-ServerDiagnosticsNegativeTest-1891890285 tempest-ServerDiagnosticsNegativeTest-1891890285-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 617.239783] nova-conductor[53002]: Traceback (most recent call last): [ 617.239783] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 617.239783] nova-conductor[53002]: return func(*args, **kwargs) [ 617.239783] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 617.239783] nova-conductor[53002]: selections = self._select_destinations( [ 617.239783] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 617.239783] nova-conductor[53002]: selections = self._schedule( [ 617.239783] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 617.239783] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 617.239783] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 617.239783] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 617.239783] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager [ 617.239783] nova-conductor[53002]: ERROR nova.conductor.manager [ 617.248776] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-be7753e5-1c95-41b5-bbdb-3962747da2e5 tempest-ServerDiagnosticsNegativeTest-1891890285 tempest-ServerDiagnosticsNegativeTest-1891890285-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 617.248776] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-be7753e5-1c95-41b5-bbdb-3962747da2e5 tempest-ServerDiagnosticsNegativeTest-1891890285 tempest-ServerDiagnosticsNegativeTest-1891890285-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 617.248776] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-be7753e5-1c95-41b5-bbdb-3962747da2e5 tempest-ServerDiagnosticsNegativeTest-1891890285 tempest-ServerDiagnosticsNegativeTest-1891890285-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 617.346135] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-be7753e5-1c95-41b5-bbdb-3962747da2e5 tempest-ServerDiagnosticsNegativeTest-1891890285 tempest-ServerDiagnosticsNegativeTest-1891890285-project-member] [instance: c3afd4ab-6b9a-4aa7-bf35-c17d9f4ec902] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 617.346789] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-be7753e5-1c95-41b5-bbdb-3962747da2e5 tempest-ServerDiagnosticsNegativeTest-1891890285 tempest-ServerDiagnosticsNegativeTest-1891890285-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 617.347469] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-be7753e5-1c95-41b5-bbdb-3962747da2e5 tempest-ServerDiagnosticsNegativeTest-1891890285 tempest-ServerDiagnosticsNegativeTest-1891890285-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 617.347718] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-be7753e5-1c95-41b5-bbdb-3962747da2e5 tempest-ServerDiagnosticsNegativeTest-1891890285 tempest-ServerDiagnosticsNegativeTest-1891890285-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 617.355131] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-be7753e5-1c95-41b5-bbdb-3962747da2e5 tempest-ServerDiagnosticsNegativeTest-1891890285 tempest-ServerDiagnosticsNegativeTest-1891890285-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 617.355131] nova-conductor[53002]: Traceback (most recent call last): [ 617.355131] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 617.355131] nova-conductor[53002]: return func(*args, **kwargs) [ 617.355131] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 617.355131] nova-conductor[53002]: selections = self._select_destinations( [ 617.355131] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 617.355131] nova-conductor[53002]: selections = self._schedule( [ 617.355131] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 617.355131] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 617.355131] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 617.355131] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 617.355131] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 617.355131] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 617.355131] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-be7753e5-1c95-41b5-bbdb-3962747da2e5 tempest-ServerDiagnosticsNegativeTest-1891890285 tempest-ServerDiagnosticsNegativeTest-1891890285-project-member] [instance: c3afd4ab-6b9a-4aa7-bf35-c17d9f4ec902] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager [None req-224d5eb4-c384-4614-ac9b-1bedab94bee9 tempest-ServerShowV247Test-1850204938 tempest-ServerShowV247Test-1850204938-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 618.035875] nova-conductor[53001]: Traceback (most recent call last): [ 618.035875] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 618.035875] nova-conductor[53001]: return func(*args, **kwargs) [ 618.035875] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 618.035875] nova-conductor[53001]: selections = self._select_destinations( [ 618.035875] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 618.035875] nova-conductor[53001]: selections = self._schedule( [ 618.035875] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 618.035875] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 618.035875] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 618.035875] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 618.035875] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager [ 618.035875] nova-conductor[53001]: ERROR nova.conductor.manager [ 618.045293] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-224d5eb4-c384-4614-ac9b-1bedab94bee9 tempest-ServerShowV247Test-1850204938 tempest-ServerShowV247Test-1850204938-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 618.045562] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-224d5eb4-c384-4614-ac9b-1bedab94bee9 tempest-ServerShowV247Test-1850204938 tempest-ServerShowV247Test-1850204938-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 618.045754] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-224d5eb4-c384-4614-ac9b-1bedab94bee9 tempest-ServerShowV247Test-1850204938 tempest-ServerShowV247Test-1850204938-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 618.105182] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-224d5eb4-c384-4614-ac9b-1bedab94bee9 tempest-ServerShowV247Test-1850204938 tempest-ServerShowV247Test-1850204938-project-member] [instance: 14a6d34a-d683-4278-bd86-67457755adb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 618.107403] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-224d5eb4-c384-4614-ac9b-1bedab94bee9 tempest-ServerShowV247Test-1850204938 tempest-ServerShowV247Test-1850204938-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 618.107403] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-224d5eb4-c384-4614-ac9b-1bedab94bee9 tempest-ServerShowV247Test-1850204938 tempest-ServerShowV247Test-1850204938-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 618.107403] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-224d5eb4-c384-4614-ac9b-1bedab94bee9 tempest-ServerShowV247Test-1850204938 tempest-ServerShowV247Test-1850204938-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 618.111132] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-224d5eb4-c384-4614-ac9b-1bedab94bee9 tempest-ServerShowV247Test-1850204938 tempest-ServerShowV247Test-1850204938-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 618.111132] nova-conductor[53001]: Traceback (most recent call last): [ 618.111132] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 618.111132] nova-conductor[53001]: return func(*args, **kwargs) [ 618.111132] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 618.111132] nova-conductor[53001]: selections = self._select_destinations( [ 618.111132] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 618.111132] nova-conductor[53001]: selections = self._schedule( [ 618.111132] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 618.111132] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 618.111132] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 618.111132] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 618.111132] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 618.111132] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 618.111919] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-224d5eb4-c384-4614-ac9b-1bedab94bee9 tempest-ServerShowV247Test-1850204938 tempest-ServerShowV247Test-1850204938-project-member] [instance: 14a6d34a-d683-4278-bd86-67457755adb7] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager [None req-5f8cfda4-191a-4306-a318-0d42c94c3664 tempest-ServerShowV257Test-29180505 tempest-ServerShowV257Test-29180505-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 622.971210] nova-conductor[53002]: Traceback (most recent call last): [ 622.971210] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 622.971210] nova-conductor[53002]: return func(*args, **kwargs) [ 622.971210] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 622.971210] nova-conductor[53002]: selections = self._select_destinations( [ 622.971210] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 622.971210] nova-conductor[53002]: selections = self._schedule( [ 622.971210] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 622.971210] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 622.971210] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 622.971210] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 622.971210] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager [ 622.971210] nova-conductor[53002]: ERROR nova.conductor.manager [ 622.979615] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-5f8cfda4-191a-4306-a318-0d42c94c3664 tempest-ServerShowV257Test-29180505 tempest-ServerShowV257Test-29180505-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 622.979840] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-5f8cfda4-191a-4306-a318-0d42c94c3664 tempest-ServerShowV257Test-29180505 tempest-ServerShowV257Test-29180505-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 622.980120] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-5f8cfda4-191a-4306-a318-0d42c94c3664 tempest-ServerShowV257Test-29180505 tempest-ServerShowV257Test-29180505-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 623.035487] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-5f8cfda4-191a-4306-a318-0d42c94c3664 tempest-ServerShowV257Test-29180505 tempest-ServerShowV257Test-29180505-project-member] [instance: 76e7e57d-68fa-487b-9a40-00f82b2a93e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 623.036378] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-5f8cfda4-191a-4306-a318-0d42c94c3664 tempest-ServerShowV257Test-29180505 tempest-ServerShowV257Test-29180505-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 623.037303] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-5f8cfda4-191a-4306-a318-0d42c94c3664 tempest-ServerShowV257Test-29180505 tempest-ServerShowV257Test-29180505-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 623.037303] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-5f8cfda4-191a-4306-a318-0d42c94c3664 tempest-ServerShowV257Test-29180505 tempest-ServerShowV257Test-29180505-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 623.041364] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-5f8cfda4-191a-4306-a318-0d42c94c3664 tempest-ServerShowV257Test-29180505 tempest-ServerShowV257Test-29180505-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 623.041364] nova-conductor[53002]: Traceback (most recent call last): [ 623.041364] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 623.041364] nova-conductor[53002]: return func(*args, **kwargs) [ 623.041364] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 623.041364] nova-conductor[53002]: selections = self._select_destinations( [ 623.041364] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 623.041364] nova-conductor[53002]: selections = self._schedule( [ 623.041364] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 623.041364] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 623.041364] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 623.041364] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 623.041364] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 623.041364] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 623.041890] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-5f8cfda4-191a-4306-a318-0d42c94c3664 tempest-ServerShowV257Test-29180505 tempest-ServerShowV257Test-29180505-project-member] [instance: 76e7e57d-68fa-487b-9a40-00f82b2a93e2] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager [None req-95982d84-97fa-4b26-afbc-50ad0c1d17ac tempest-ServerPasswordTestJSON-1466621771 tempest-ServerPasswordTestJSON-1466621771-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 628.370240] nova-conductor[53002]: Traceback (most recent call last): [ 628.370240] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 628.370240] nova-conductor[53002]: return func(*args, **kwargs) [ 628.370240] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 628.370240] nova-conductor[53002]: selections = self._select_destinations( [ 628.370240] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 628.370240] nova-conductor[53002]: selections = self._schedule( [ 628.370240] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 628.370240] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 628.370240] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 628.370240] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 628.370240] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager [ 628.370240] nova-conductor[53002]: ERROR nova.conductor.manager [ 628.377708] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-95982d84-97fa-4b26-afbc-50ad0c1d17ac tempest-ServerPasswordTestJSON-1466621771 tempest-ServerPasswordTestJSON-1466621771-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 628.378069] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-95982d84-97fa-4b26-afbc-50ad0c1d17ac tempest-ServerPasswordTestJSON-1466621771 tempest-ServerPasswordTestJSON-1466621771-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 628.378252] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-95982d84-97fa-4b26-afbc-50ad0c1d17ac tempest-ServerPasswordTestJSON-1466621771 tempest-ServerPasswordTestJSON-1466621771-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 628.457787] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-95982d84-97fa-4b26-afbc-50ad0c1d17ac tempest-ServerPasswordTestJSON-1466621771 tempest-ServerPasswordTestJSON-1466621771-project-member] [instance: 60eadf32-c87c-4d69-bf7b-7c9fcb64277c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 628.458664] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-95982d84-97fa-4b26-afbc-50ad0c1d17ac tempest-ServerPasswordTestJSON-1466621771 tempest-ServerPasswordTestJSON-1466621771-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 628.458934] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-95982d84-97fa-4b26-afbc-50ad0c1d17ac tempest-ServerPasswordTestJSON-1466621771 tempest-ServerPasswordTestJSON-1466621771-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 628.459174] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-95982d84-97fa-4b26-afbc-50ad0c1d17ac tempest-ServerPasswordTestJSON-1466621771 tempest-ServerPasswordTestJSON-1466621771-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 628.467778] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-95982d84-97fa-4b26-afbc-50ad0c1d17ac tempest-ServerPasswordTestJSON-1466621771 tempest-ServerPasswordTestJSON-1466621771-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 628.467778] nova-conductor[53002]: Traceback (most recent call last): [ 628.467778] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 628.467778] nova-conductor[53002]: return func(*args, **kwargs) [ 628.467778] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 628.467778] nova-conductor[53002]: selections = self._select_destinations( [ 628.467778] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 628.467778] nova-conductor[53002]: selections = self._schedule( [ 628.467778] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 628.467778] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 628.467778] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 628.467778] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 628.467778] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 628.467778] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 628.468333] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-95982d84-97fa-4b26-afbc-50ad0c1d17ac tempest-ServerPasswordTestJSON-1466621771 tempest-ServerPasswordTestJSON-1466621771-project-member] [instance: 60eadf32-c87c-4d69-bf7b-7c9fcb64277c] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 628.600942] nova-conductor[53001]: Traceback (most recent call last): [ 628.600942] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 628.600942] nova-conductor[53001]: return func(*args, **kwargs) [ 628.600942] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 628.600942] nova-conductor[53001]: selections = self._select_destinations( [ 628.600942] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 628.600942] nova-conductor[53001]: selections = self._schedule( [ 628.600942] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 628.600942] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 628.600942] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 628.600942] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 628.600942] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager [ 628.600942] nova-conductor[53001]: ERROR nova.conductor.manager [ 628.619071] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 628.619071] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 628.619071] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager [None req-ac3170bc-084f-49be-8ac4-0f04d5263000 tempest-ServerShowV247Test-1850204938 tempest-ServerShowV247Test-1850204938-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 628.699957] nova-conductor[53002]: Traceback (most recent call last): [ 628.699957] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 628.699957] nova-conductor[53002]: return func(*args, **kwargs) [ 628.699957] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 628.699957] nova-conductor[53002]: selections = self._select_destinations( [ 628.699957] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 628.699957] nova-conductor[53002]: selections = self._schedule( [ 628.699957] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 628.699957] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 628.699957] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 628.699957] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 628.699957] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager [ 628.699957] nova-conductor[53002]: ERROR nova.conductor.manager [ 628.709193] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-ac3170bc-084f-49be-8ac4-0f04d5263000 tempest-ServerShowV247Test-1850204938 tempest-ServerShowV247Test-1850204938-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 628.709193] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-ac3170bc-084f-49be-8ac4-0f04d5263000 tempest-ServerShowV247Test-1850204938 tempest-ServerShowV247Test-1850204938-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 628.709448] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-ac3170bc-084f-49be-8ac4-0f04d5263000 tempest-ServerShowV247Test-1850204938 tempest-ServerShowV247Test-1850204938-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 628.730053] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] [instance: 20cb2375-bea5-430c-bcea-ad27196e857d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 628.730805] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 628.731029] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 628.731206] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 628.738918] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 628.738918] nova-conductor[53001]: Traceback (most recent call last): [ 628.738918] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 628.738918] nova-conductor[53001]: return func(*args, **kwargs) [ 628.738918] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 628.738918] nova-conductor[53001]: selections = self._select_destinations( [ 628.738918] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 628.738918] nova-conductor[53001]: selections = self._schedule( [ 628.738918] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 628.738918] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 628.738918] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 628.738918] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 628.738918] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 628.738918] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 628.738918] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] [instance: 20cb2375-bea5-430c-bcea-ad27196e857d] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 628.779550] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 628.779789] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 628.779972] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 628.784704] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-ac3170bc-084f-49be-8ac4-0f04d5263000 tempest-ServerShowV247Test-1850204938 tempest-ServerShowV247Test-1850204938-project-member] [instance: a587b167-2acc-4a57-a7bd-a527103dd03c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 628.784704] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-ac3170bc-084f-49be-8ac4-0f04d5263000 tempest-ServerShowV247Test-1850204938 tempest-ServerShowV247Test-1850204938-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 628.784704] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-ac3170bc-084f-49be-8ac4-0f04d5263000 tempest-ServerShowV247Test-1850204938 tempest-ServerShowV247Test-1850204938-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 628.784704] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-ac3170bc-084f-49be-8ac4-0f04d5263000 tempest-ServerShowV247Test-1850204938 tempest-ServerShowV247Test-1850204938-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 628.788413] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-ac3170bc-084f-49be-8ac4-0f04d5263000 tempest-ServerShowV247Test-1850204938 tempest-ServerShowV247Test-1850204938-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 628.788413] nova-conductor[53002]: Traceback (most recent call last): [ 628.788413] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 628.788413] nova-conductor[53002]: return func(*args, **kwargs) [ 628.788413] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 628.788413] nova-conductor[53002]: selections = self._select_destinations( [ 628.788413] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 628.788413] nova-conductor[53002]: selections = self._schedule( [ 628.788413] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 628.788413] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 628.788413] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 628.788413] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 628.788413] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 628.788413] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 628.792537] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-ac3170bc-084f-49be-8ac4-0f04d5263000 tempest-ServerShowV247Test-1850204938 tempest-ServerShowV247Test-1850204938-project-member] [instance: a587b167-2acc-4a57-a7bd-a527103dd03c] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 628.856095] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] [instance: 48f57c1b-ad28-4a26-8f9c-9bbb37b1006d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 628.856095] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 628.856095] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 628.856095] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 628.859392] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 628.859392] nova-conductor[53001]: Traceback (most recent call last): [ 628.859392] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 628.859392] nova-conductor[53001]: return func(*args, **kwargs) [ 628.859392] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 628.859392] nova-conductor[53001]: selections = self._select_destinations( [ 628.859392] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 628.859392] nova-conductor[53001]: selections = self._schedule( [ 628.859392] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 628.859392] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 628.859392] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 628.859392] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 628.859392] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 628.859392] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 628.860106] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] [instance: 48f57c1b-ad28-4a26-8f9c-9bbb37b1006d] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 628.887439] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 628.887669] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 628.887876] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 628.949291] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] [instance: 4a50eb22-86e2-42d7-bbc0-7bd12eb2a8a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 628.950397] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 628.950733] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 628.951386] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 628.958227] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 628.958227] nova-conductor[53001]: Traceback (most recent call last): [ 628.958227] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 628.958227] nova-conductor[53001]: return func(*args, **kwargs) [ 628.958227] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 628.958227] nova-conductor[53001]: selections = self._select_destinations( [ 628.958227] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 628.958227] nova-conductor[53001]: selections = self._schedule( [ 628.958227] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 628.958227] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 628.958227] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 628.958227] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 628.958227] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 628.958227] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 628.958227] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-d2ed6bcf-f926-4a0c-9fee-9b49b12a0d55 tempest-ListServersNegativeTestJSON-250475709 tempest-ListServersNegativeTestJSON-250475709-project-member] [instance: 4a50eb22-86e2-42d7-bbc0-7bd12eb2a8a0] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager [None req-6da52593-b6a3-481d-bc6c-9d3811045aa9 tempest-ServerAddressesNegativeTestJSON-691330618 tempest-ServerAddressesNegativeTestJSON-691330618-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 630.100486] nova-conductor[53001]: Traceback (most recent call last): [ 630.100486] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 630.100486] nova-conductor[53001]: return func(*args, **kwargs) [ 630.100486] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 630.100486] nova-conductor[53001]: selections = self._select_destinations( [ 630.100486] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 630.100486] nova-conductor[53001]: selections = self._schedule( [ 630.100486] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 630.100486] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 630.100486] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 630.100486] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 630.100486] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager [ 630.100486] nova-conductor[53001]: ERROR nova.conductor.manager [ 630.109261] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-6da52593-b6a3-481d-bc6c-9d3811045aa9 tempest-ServerAddressesNegativeTestJSON-691330618 tempest-ServerAddressesNegativeTestJSON-691330618-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 630.110409] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-6da52593-b6a3-481d-bc6c-9d3811045aa9 tempest-ServerAddressesNegativeTestJSON-691330618 tempest-ServerAddressesNegativeTestJSON-691330618-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 630.110409] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-6da52593-b6a3-481d-bc6c-9d3811045aa9 tempest-ServerAddressesNegativeTestJSON-691330618 tempest-ServerAddressesNegativeTestJSON-691330618-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 630.176994] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-6da52593-b6a3-481d-bc6c-9d3811045aa9 tempest-ServerAddressesNegativeTestJSON-691330618 tempest-ServerAddressesNegativeTestJSON-691330618-project-member] [instance: cf1537fe-522d-44b9-a8a1-d71427cfb822] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 630.178042] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-6da52593-b6a3-481d-bc6c-9d3811045aa9 tempest-ServerAddressesNegativeTestJSON-691330618 tempest-ServerAddressesNegativeTestJSON-691330618-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 630.178610] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-6da52593-b6a3-481d-bc6c-9d3811045aa9 tempest-ServerAddressesNegativeTestJSON-691330618 tempest-ServerAddressesNegativeTestJSON-691330618-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 630.178962] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-6da52593-b6a3-481d-bc6c-9d3811045aa9 tempest-ServerAddressesNegativeTestJSON-691330618 tempest-ServerAddressesNegativeTestJSON-691330618-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 630.184340] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-6da52593-b6a3-481d-bc6c-9d3811045aa9 tempest-ServerAddressesNegativeTestJSON-691330618 tempest-ServerAddressesNegativeTestJSON-691330618-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 630.184340] nova-conductor[53001]: Traceback (most recent call last): [ 630.184340] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 630.184340] nova-conductor[53001]: return func(*args, **kwargs) [ 630.184340] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 630.184340] nova-conductor[53001]: selections = self._select_destinations( [ 630.184340] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 630.184340] nova-conductor[53001]: selections = self._schedule( [ 630.184340] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 630.184340] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 630.184340] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 630.184340] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 630.184340] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 630.184340] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 630.185943] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-6da52593-b6a3-481d-bc6c-9d3811045aa9 tempest-ServerAddressesNegativeTestJSON-691330618 tempest-ServerAddressesNegativeTestJSON-691330618-project-member] [instance: cf1537fe-522d-44b9-a8a1-d71427cfb822] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager [None req-8e4e79d1-d3f2-42ec-8ae4-6f04b9b7bfb9 tempest-ServersAdminNegativeTestJSON-725663573 tempest-ServersAdminNegativeTestJSON-725663573-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 631.951921] nova-conductor[53002]: Traceback (most recent call last): [ 631.951921] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 631.951921] nova-conductor[53002]: return func(*args, **kwargs) [ 631.951921] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 631.951921] nova-conductor[53002]: selections = self._select_destinations( [ 631.951921] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 631.951921] nova-conductor[53002]: selections = self._schedule( [ 631.951921] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 631.951921] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 631.951921] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 631.951921] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 631.951921] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager [ 631.951921] nova-conductor[53002]: ERROR nova.conductor.manager [ 631.961876] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-8e4e79d1-d3f2-42ec-8ae4-6f04b9b7bfb9 tempest-ServersAdminNegativeTestJSON-725663573 tempest-ServersAdminNegativeTestJSON-725663573-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 631.963733] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-8e4e79d1-d3f2-42ec-8ae4-6f04b9b7bfb9 tempest-ServersAdminNegativeTestJSON-725663573 tempest-ServersAdminNegativeTestJSON-725663573-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 631.964745] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-8e4e79d1-d3f2-42ec-8ae4-6f04b9b7bfb9 tempest-ServersAdminNegativeTestJSON-725663573 tempest-ServersAdminNegativeTestJSON-725663573-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 632.039809] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-8e4e79d1-d3f2-42ec-8ae4-6f04b9b7bfb9 tempest-ServersAdminNegativeTestJSON-725663573 tempest-ServersAdminNegativeTestJSON-725663573-project-member] [instance: bdb2cc98-6ca3-4bb9-9827-8f8c88cba71d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 632.040865] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-8e4e79d1-d3f2-42ec-8ae4-6f04b9b7bfb9 tempest-ServersAdminNegativeTestJSON-725663573 tempest-ServersAdminNegativeTestJSON-725663573-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 632.041106] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-8e4e79d1-d3f2-42ec-8ae4-6f04b9b7bfb9 tempest-ServersAdminNegativeTestJSON-725663573 tempest-ServersAdminNegativeTestJSON-725663573-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 632.041282] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-8e4e79d1-d3f2-42ec-8ae4-6f04b9b7bfb9 tempest-ServersAdminNegativeTestJSON-725663573 tempest-ServersAdminNegativeTestJSON-725663573-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 632.047470] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-8e4e79d1-d3f2-42ec-8ae4-6f04b9b7bfb9 tempest-ServersAdminNegativeTestJSON-725663573 tempest-ServersAdminNegativeTestJSON-725663573-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 632.047470] nova-conductor[53002]: Traceback (most recent call last): [ 632.047470] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 632.047470] nova-conductor[53002]: return func(*args, **kwargs) [ 632.047470] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 632.047470] nova-conductor[53002]: selections = self._select_destinations( [ 632.047470] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 632.047470] nova-conductor[53002]: selections = self._schedule( [ 632.047470] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 632.047470] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 632.047470] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 632.047470] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 632.047470] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 632.047470] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 632.047470] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-8e4e79d1-d3f2-42ec-8ae4-6f04b9b7bfb9 tempest-ServersAdminNegativeTestJSON-725663573 tempest-ServersAdminNegativeTestJSON-725663573-project-member] [instance: bdb2cc98-6ca3-4bb9-9827-8f8c88cba71d] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager [None req-8b23ec3e-4601-4c01-9454-6addd814c3ad tempest-ServerMetadataTestJSON-1965896882 tempest-ServerMetadataTestJSON-1965896882-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 632.389601] nova-conductor[53001]: Traceback (most recent call last): [ 632.389601] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 632.389601] nova-conductor[53001]: return func(*args, **kwargs) [ 632.389601] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 632.389601] nova-conductor[53001]: selections = self._select_destinations( [ 632.389601] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 632.389601] nova-conductor[53001]: selections = self._schedule( [ 632.389601] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 632.389601] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 632.389601] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 632.389601] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 632.389601] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager [ 632.389601] nova-conductor[53001]: ERROR nova.conductor.manager [ 632.402208] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-8b23ec3e-4601-4c01-9454-6addd814c3ad tempest-ServerMetadataTestJSON-1965896882 tempest-ServerMetadataTestJSON-1965896882-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 632.402208] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-8b23ec3e-4601-4c01-9454-6addd814c3ad tempest-ServerMetadataTestJSON-1965896882 tempest-ServerMetadataTestJSON-1965896882-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 632.402610] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-8b23ec3e-4601-4c01-9454-6addd814c3ad tempest-ServerMetadataTestJSON-1965896882 tempest-ServerMetadataTestJSON-1965896882-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 632.474376] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-8b23ec3e-4601-4c01-9454-6addd814c3ad tempest-ServerMetadataTestJSON-1965896882 tempest-ServerMetadataTestJSON-1965896882-project-member] [instance: de701b4a-4cb7-4e38-86a5-a1acb40e7de8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 632.474376] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-8b23ec3e-4601-4c01-9454-6addd814c3ad tempest-ServerMetadataTestJSON-1965896882 tempest-ServerMetadataTestJSON-1965896882-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 632.474376] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-8b23ec3e-4601-4c01-9454-6addd814c3ad tempest-ServerMetadataTestJSON-1965896882 tempest-ServerMetadataTestJSON-1965896882-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 632.477309] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-8b23ec3e-4601-4c01-9454-6addd814c3ad tempest-ServerMetadataTestJSON-1965896882 tempest-ServerMetadataTestJSON-1965896882-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 632.480257] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-8b23ec3e-4601-4c01-9454-6addd814c3ad tempest-ServerMetadataTestJSON-1965896882 tempest-ServerMetadataTestJSON-1965896882-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 632.480257] nova-conductor[53001]: Traceback (most recent call last): [ 632.480257] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 632.480257] nova-conductor[53001]: return func(*args, **kwargs) [ 632.480257] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 632.480257] nova-conductor[53001]: selections = self._select_destinations( [ 632.480257] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 632.480257] nova-conductor[53001]: selections = self._schedule( [ 632.480257] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 632.480257] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 632.480257] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 632.480257] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 632.480257] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 632.480257] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 632.481918] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-8b23ec3e-4601-4c01-9454-6addd814c3ad tempest-ServerMetadataTestJSON-1965896882 tempest-ServerMetadataTestJSON-1965896882-project-member] [instance: de701b4a-4cb7-4e38-86a5-a1acb40e7de8] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 635.857383] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-d509edda-321c-4de0-9ca5-0b05c6399b67 tempest-InstanceActionsV221TestJSON-166999117 tempest-InstanceActionsV221TestJSON-166999117-project-member] Took 0.16 seconds to select destinations for 1 instance(s). {{(pid=53001) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 635.881920] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d509edda-321c-4de0-9ca5-0b05c6399b67 tempest-InstanceActionsV221TestJSON-166999117 tempest-InstanceActionsV221TestJSON-166999117-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 635.881920] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d509edda-321c-4de0-9ca5-0b05c6399b67 tempest-InstanceActionsV221TestJSON-166999117 tempest-InstanceActionsV221TestJSON-166999117-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 635.881920] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d509edda-321c-4de0-9ca5-0b05c6399b67 tempest-InstanceActionsV221TestJSON-166999117 tempest-InstanceActionsV221TestJSON-166999117-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 635.926259] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d509edda-321c-4de0-9ca5-0b05c6399b67 tempest-InstanceActionsV221TestJSON-166999117 tempest-InstanceActionsV221TestJSON-166999117-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 635.926349] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d509edda-321c-4de0-9ca5-0b05c6399b67 tempest-InstanceActionsV221TestJSON-166999117 tempest-InstanceActionsV221TestJSON-166999117-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 635.926446] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d509edda-321c-4de0-9ca5-0b05c6399b67 tempest-InstanceActionsV221TestJSON-166999117 tempest-InstanceActionsV221TestJSON-166999117-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 635.926801] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d509edda-321c-4de0-9ca5-0b05c6399b67 tempest-InstanceActionsV221TestJSON-166999117 tempest-InstanceActionsV221TestJSON-166999117-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 635.927616] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d509edda-321c-4de0-9ca5-0b05c6399b67 tempest-InstanceActionsV221TestJSON-166999117 tempest-InstanceActionsV221TestJSON-166999117-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 635.927616] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d509edda-321c-4de0-9ca5-0b05c6399b67 tempest-InstanceActionsV221TestJSON-166999117 tempest-InstanceActionsV221TestJSON-166999117-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 635.938658] nova-conductor[53001]: DEBUG nova.quota [None req-d509edda-321c-4de0-9ca5-0b05c6399b67 tempest-InstanceActionsV221TestJSON-166999117 tempest-InstanceActionsV221TestJSON-166999117-project-member] Getting quotas for project 1d4a1eeaa09d4f1e8af6e69bd9559be0. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 635.941875] nova-conductor[53001]: DEBUG nova.quota [None req-d509edda-321c-4de0-9ca5-0b05c6399b67 tempest-InstanceActionsV221TestJSON-166999117 tempest-InstanceActionsV221TestJSON-166999117-project-member] Getting quotas for user 51b1b7c43f4d421d86136375ede56642 and project 1d4a1eeaa09d4f1e8af6e69bd9559be0. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 635.947742] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-d509edda-321c-4de0-9ca5-0b05c6399b67 tempest-InstanceActionsV221TestJSON-166999117 tempest-InstanceActionsV221TestJSON-166999117-project-member] [instance: 2751bdfb-2f28-48e0-98c2-f232ed6da6df] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53001) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 635.948329] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d509edda-321c-4de0-9ca5-0b05c6399b67 tempest-InstanceActionsV221TestJSON-166999117 tempest-InstanceActionsV221TestJSON-166999117-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 635.948539] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d509edda-321c-4de0-9ca5-0b05c6399b67 tempest-InstanceActionsV221TestJSON-166999117 tempest-InstanceActionsV221TestJSON-166999117-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 635.948858] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d509edda-321c-4de0-9ca5-0b05c6399b67 tempest-InstanceActionsV221TestJSON-166999117 tempest-InstanceActionsV221TestJSON-166999117-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 635.952575] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-d509edda-321c-4de0-9ca5-0b05c6399b67 tempest-InstanceActionsV221TestJSON-166999117 tempest-InstanceActionsV221TestJSON-166999117-project-member] [instance: 2751bdfb-2f28-48e0-98c2-f232ed6da6df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 635.953315] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d509edda-321c-4de0-9ca5-0b05c6399b67 tempest-InstanceActionsV221TestJSON-166999117 tempest-InstanceActionsV221TestJSON-166999117-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 635.953519] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d509edda-321c-4de0-9ca5-0b05c6399b67 tempest-InstanceActionsV221TestJSON-166999117 tempest-InstanceActionsV221TestJSON-166999117-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 635.954352] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d509edda-321c-4de0-9ca5-0b05c6399b67 tempest-InstanceActionsV221TestJSON-166999117 tempest-InstanceActionsV221TestJSON-166999117-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 635.969226] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d509edda-321c-4de0-9ca5-0b05c6399b67 tempest-InstanceActionsV221TestJSON-166999117 tempest-InstanceActionsV221TestJSON-166999117-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 635.969467] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d509edda-321c-4de0-9ca5-0b05c6399b67 tempest-InstanceActionsV221TestJSON-166999117 tempest-InstanceActionsV221TestJSON-166999117-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 635.969635] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d509edda-321c-4de0-9ca5-0b05c6399b67 tempest-InstanceActionsV221TestJSON-166999117 tempest-InstanceActionsV221TestJSON-166999117-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 636.370989] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-4b7be5c0-f76b-41bf-a3bd-40a889aab22d tempest-ServersV294TestFqdnHostnames-45939237 tempest-ServersV294TestFqdnHostnames-45939237-project-member] Took 0.17 seconds to select destinations for 1 instance(s). {{(pid=53002) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 636.398416] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-4b7be5c0-f76b-41bf-a3bd-40a889aab22d tempest-ServersV294TestFqdnHostnames-45939237 tempest-ServersV294TestFqdnHostnames-45939237-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 636.398754] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-4b7be5c0-f76b-41bf-a3bd-40a889aab22d tempest-ServersV294TestFqdnHostnames-45939237 tempest-ServersV294TestFqdnHostnames-45939237-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 636.402441] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-4b7be5c0-f76b-41bf-a3bd-40a889aab22d tempest-ServersV294TestFqdnHostnames-45939237 tempest-ServersV294TestFqdnHostnames-45939237-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 636.450895] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-4b7be5c0-f76b-41bf-a3bd-40a889aab22d tempest-ServersV294TestFqdnHostnames-45939237 tempest-ServersV294TestFqdnHostnames-45939237-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 636.451207] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-4b7be5c0-f76b-41bf-a3bd-40a889aab22d tempest-ServersV294TestFqdnHostnames-45939237 tempest-ServersV294TestFqdnHostnames-45939237-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 636.451461] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-4b7be5c0-f76b-41bf-a3bd-40a889aab22d tempest-ServersV294TestFqdnHostnames-45939237 tempest-ServersV294TestFqdnHostnames-45939237-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 636.453196] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-4b7be5c0-f76b-41bf-a3bd-40a889aab22d tempest-ServersV294TestFqdnHostnames-45939237 tempest-ServersV294TestFqdnHostnames-45939237-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 636.453196] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-4b7be5c0-f76b-41bf-a3bd-40a889aab22d tempest-ServersV294TestFqdnHostnames-45939237 tempest-ServersV294TestFqdnHostnames-45939237-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 636.453196] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-4b7be5c0-f76b-41bf-a3bd-40a889aab22d tempest-ServersV294TestFqdnHostnames-45939237 tempest-ServersV294TestFqdnHostnames-45939237-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 636.465948] nova-conductor[53002]: DEBUG nova.quota [None req-4b7be5c0-f76b-41bf-a3bd-40a889aab22d tempest-ServersV294TestFqdnHostnames-45939237 tempest-ServersV294TestFqdnHostnames-45939237-project-member] Getting quotas for project ee8cc26b75e64dbab138f327470b88d4. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 636.469376] nova-conductor[53002]: DEBUG nova.quota [None req-4b7be5c0-f76b-41bf-a3bd-40a889aab22d tempest-ServersV294TestFqdnHostnames-45939237 tempest-ServersV294TestFqdnHostnames-45939237-project-member] Getting quotas for user 78216297d3664124b0e2a03b6d970704 and project ee8cc26b75e64dbab138f327470b88d4. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 636.483572] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-4b7be5c0-f76b-41bf-a3bd-40a889aab22d tempest-ServersV294TestFqdnHostnames-45939237 tempest-ServersV294TestFqdnHostnames-45939237-project-member] [instance: 83ecd8bb-ba2b-4151-986b-26f50b54e8e2] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53002) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 636.484134] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-4b7be5c0-f76b-41bf-a3bd-40a889aab22d tempest-ServersV294TestFqdnHostnames-45939237 tempest-ServersV294TestFqdnHostnames-45939237-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 636.484549] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-4b7be5c0-f76b-41bf-a3bd-40a889aab22d tempest-ServersV294TestFqdnHostnames-45939237 tempest-ServersV294TestFqdnHostnames-45939237-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 636.484549] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-4b7be5c0-f76b-41bf-a3bd-40a889aab22d tempest-ServersV294TestFqdnHostnames-45939237 tempest-ServersV294TestFqdnHostnames-45939237-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 636.493295] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-4b7be5c0-f76b-41bf-a3bd-40a889aab22d tempest-ServersV294TestFqdnHostnames-45939237 tempest-ServersV294TestFqdnHostnames-45939237-project-member] [instance: 83ecd8bb-ba2b-4151-986b-26f50b54e8e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 636.495677] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-4b7be5c0-f76b-41bf-a3bd-40a889aab22d tempest-ServersV294TestFqdnHostnames-45939237 tempest-ServersV294TestFqdnHostnames-45939237-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 636.495677] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-4b7be5c0-f76b-41bf-a3bd-40a889aab22d tempest-ServersV294TestFqdnHostnames-45939237 tempest-ServersV294TestFqdnHostnames-45939237-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 636.495677] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-4b7be5c0-f76b-41bf-a3bd-40a889aab22d tempest-ServersV294TestFqdnHostnames-45939237 tempest-ServersV294TestFqdnHostnames-45939237-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 636.522637] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-4b7be5c0-f76b-41bf-a3bd-40a889aab22d tempest-ServersV294TestFqdnHostnames-45939237 tempest-ServersV294TestFqdnHostnames-45939237-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 636.522860] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-4b7be5c0-f76b-41bf-a3bd-40a889aab22d tempest-ServersV294TestFqdnHostnames-45939237 tempest-ServersV294TestFqdnHostnames-45939237-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 636.523965] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-4b7be5c0-f76b-41bf-a3bd-40a889aab22d tempest-ServersV294TestFqdnHostnames-45939237 tempest-ServersV294TestFqdnHostnames-45939237-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 646.683773] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-0c8ec332-5019-4190-91b8-9f74d2637704 tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Took 0.16 seconds to select destinations for 1 instance(s). {{(pid=53001) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 646.703193] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0c8ec332-5019-4190-91b8-9f74d2637704 tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 646.703444] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0c8ec332-5019-4190-91b8-9f74d2637704 tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 646.703787] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0c8ec332-5019-4190-91b8-9f74d2637704 tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 646.749202] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0c8ec332-5019-4190-91b8-9f74d2637704 tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 646.749452] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0c8ec332-5019-4190-91b8-9f74d2637704 tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 646.749631] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0c8ec332-5019-4190-91b8-9f74d2637704 tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 646.750014] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0c8ec332-5019-4190-91b8-9f74d2637704 tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 646.750221] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0c8ec332-5019-4190-91b8-9f74d2637704 tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 646.750390] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0c8ec332-5019-4190-91b8-9f74d2637704 tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 646.766485] nova-conductor[53001]: DEBUG nova.quota [None req-0c8ec332-5019-4190-91b8-9f74d2637704 tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Getting quotas for project b22cd34069e444cfac6558f88d753b56. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 646.769822] nova-conductor[53001]: DEBUG nova.quota [None req-0c8ec332-5019-4190-91b8-9f74d2637704 tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Getting quotas for user 9182c7e1ada64547a03c0d3248c361fa and project b22cd34069e444cfac6558f88d753b56. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 646.779012] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-0c8ec332-5019-4190-91b8-9f74d2637704 tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] [instance: afb2cdc1-74ec-4d08-85cb-e96b4071f661] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53001) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 646.779724] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0c8ec332-5019-4190-91b8-9f74d2637704 tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 646.780037] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0c8ec332-5019-4190-91b8-9f74d2637704 tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 646.780284] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0c8ec332-5019-4190-91b8-9f74d2637704 tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 646.784069] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-0c8ec332-5019-4190-91b8-9f74d2637704 tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] [instance: afb2cdc1-74ec-4d08-85cb-e96b4071f661] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 646.784904] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0c8ec332-5019-4190-91b8-9f74d2637704 tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 646.785157] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0c8ec332-5019-4190-91b8-9f74d2637704 tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 646.785341] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0c8ec332-5019-4190-91b8-9f74d2637704 tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 646.815414] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0c8ec332-5019-4190-91b8-9f74d2637704 tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 646.815414] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0c8ec332-5019-4190-91b8-9f74d2637704 tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 646.815650] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0c8ec332-5019-4190-91b8-9f74d2637704 tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 649.565038] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Took 0.15 seconds to select destinations for 1 instance(s). {{(pid=53001) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 649.581092] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 649.581092] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 649.581092] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 649.625162] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 649.625450] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 649.625660] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 649.626099] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 649.626630] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 649.626853] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 649.638835] nova-conductor[53001]: DEBUG nova.quota [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Getting quotas for project 990db39db03d40fcae252ac1848180a1. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 649.642977] nova-conductor[53001]: DEBUG nova.quota [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Getting quotas for user 4cf3f3ab34694fa2b92d94ac4942c8fb and project 990db39db03d40fcae252ac1848180a1. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 649.654651] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] [instance: 8f10776c-4124-48fb-9135-d674986d4ad3] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53001) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 649.656260] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 649.656260] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 649.656995] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 649.666046] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] [instance: 8f10776c-4124-48fb-9135-d674986d4ad3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 649.666873] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 649.667104] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 649.667300] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 649.687996] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 649.687996] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 649.687996] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 654.603132] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-eb90076f-127d-4345-af44-bfa8dc28fd29 tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Took 0.18 seconds to select destinations for 1 instance(s). {{(pid=53002) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 654.619880] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb90076f-127d-4345-af44-bfa8dc28fd29 tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 654.621190] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb90076f-127d-4345-af44-bfa8dc28fd29 tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 654.621423] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb90076f-127d-4345-af44-bfa8dc28fd29 tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 654.721227] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb90076f-127d-4345-af44-bfa8dc28fd29 tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 654.721227] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb90076f-127d-4345-af44-bfa8dc28fd29 tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 654.721227] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb90076f-127d-4345-af44-bfa8dc28fd29 tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 654.721227] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb90076f-127d-4345-af44-bfa8dc28fd29 tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 654.721227] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb90076f-127d-4345-af44-bfa8dc28fd29 tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 654.721227] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb90076f-127d-4345-af44-bfa8dc28fd29 tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 654.732104] nova-conductor[53002]: DEBUG nova.quota [None req-eb90076f-127d-4345-af44-bfa8dc28fd29 tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Getting quotas for project cce08d1ae47c4fc1b1f01412cac916bd. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 654.740051] nova-conductor[53002]: DEBUG nova.quota [None req-eb90076f-127d-4345-af44-bfa8dc28fd29 tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Getting quotas for user a55618f8417d4926a3441e2620494eb0 and project cce08d1ae47c4fc1b1f01412cac916bd. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 654.744591] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-eb90076f-127d-4345-af44-bfa8dc28fd29 tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] [instance: 2f252e1d-bd99-4d70-a8ab-b3f9ce8ab9b5] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53002) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 654.745540] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb90076f-127d-4345-af44-bfa8dc28fd29 tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 654.745763] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb90076f-127d-4345-af44-bfa8dc28fd29 tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 654.745952] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb90076f-127d-4345-af44-bfa8dc28fd29 tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 654.751843] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-eb90076f-127d-4345-af44-bfa8dc28fd29 tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] [instance: 2f252e1d-bd99-4d70-a8ab-b3f9ce8ab9b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 654.752857] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb90076f-127d-4345-af44-bfa8dc28fd29 tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 654.752857] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb90076f-127d-4345-af44-bfa8dc28fd29 tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 654.752948] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb90076f-127d-4345-af44-bfa8dc28fd29 tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 654.774769] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb90076f-127d-4345-af44-bfa8dc28fd29 tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 654.774769] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb90076f-127d-4345-af44-bfa8dc28fd29 tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 654.774769] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb90076f-127d-4345-af44-bfa8dc28fd29 tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 655.294031] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-742b174a-c430-401c-9610-59b04ea9602b tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Took 0.18 seconds to select destinations for 1 instance(s). {{(pid=53001) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 655.332514] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-742b174a-c430-401c-9610-59b04ea9602b tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 655.332751] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-742b174a-c430-401c-9610-59b04ea9602b tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 655.332928] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-742b174a-c430-401c-9610-59b04ea9602b tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 655.397711] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-742b174a-c430-401c-9610-59b04ea9602b tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 655.398051] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-742b174a-c430-401c-9610-59b04ea9602b tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 655.398166] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-742b174a-c430-401c-9610-59b04ea9602b tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 655.398537] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-742b174a-c430-401c-9610-59b04ea9602b tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 655.399043] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-742b174a-c430-401c-9610-59b04ea9602b tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 655.399043] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-742b174a-c430-401c-9610-59b04ea9602b tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 655.409496] nova-conductor[53001]: DEBUG nova.quota [None req-742b174a-c430-401c-9610-59b04ea9602b tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Getting quotas for project 14b6fd8340554fe6b476f6958396a650. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 655.415703] nova-conductor[53001]: DEBUG nova.quota [None req-742b174a-c430-401c-9610-59b04ea9602b tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Getting quotas for user 7a25f2f313d042e7a5669e7646f2a6bd and project 14b6fd8340554fe6b476f6958396a650. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 655.423625] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-742b174a-c430-401c-9610-59b04ea9602b tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] [instance: be11788c-634f-40c0-8c8c-d6253d0e68ad] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53001) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 655.424212] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-742b174a-c430-401c-9610-59b04ea9602b tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 655.427017] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-742b174a-c430-401c-9610-59b04ea9602b tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 655.427017] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-742b174a-c430-401c-9610-59b04ea9602b tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 655.428606] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-742b174a-c430-401c-9610-59b04ea9602b tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] [instance: be11788c-634f-40c0-8c8c-d6253d0e68ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 655.429316] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-742b174a-c430-401c-9610-59b04ea9602b tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 655.429534] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-742b174a-c430-401c-9610-59b04ea9602b tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 655.429708] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-742b174a-c430-401c-9610-59b04ea9602b tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 655.462326] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-742b174a-c430-401c-9610-59b04ea9602b tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 655.462326] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-742b174a-c430-401c-9610-59b04ea9602b tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 655.462326] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-742b174a-c430-401c-9610-59b04ea9602b tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 656.597468] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-ea692a03-b680-4082-a4d3-36b28076ef4d tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Took 0.19 seconds to select destinations for 1 instance(s). {{(pid=53002) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 656.611318] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-ea692a03-b680-4082-a4d3-36b28076ef4d tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 656.611562] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-ea692a03-b680-4082-a4d3-36b28076ef4d tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 656.611778] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-ea692a03-b680-4082-a4d3-36b28076ef4d tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 656.659673] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-ea692a03-b680-4082-a4d3-36b28076ef4d tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 656.659902] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-ea692a03-b680-4082-a4d3-36b28076ef4d tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 656.660583] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-ea692a03-b680-4082-a4d3-36b28076ef4d tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 656.660984] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-ea692a03-b680-4082-a4d3-36b28076ef4d tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 656.661375] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-ea692a03-b680-4082-a4d3-36b28076ef4d tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 656.661572] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-ea692a03-b680-4082-a4d3-36b28076ef4d tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 656.672506] nova-conductor[53002]: DEBUG nova.quota [None req-ea692a03-b680-4082-a4d3-36b28076ef4d tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Getting quotas for project cce08d1ae47c4fc1b1f01412cac916bd. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 656.676283] nova-conductor[53002]: DEBUG nova.quota [None req-ea692a03-b680-4082-a4d3-36b28076ef4d tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Getting quotas for user a55618f8417d4926a3441e2620494eb0 and project cce08d1ae47c4fc1b1f01412cac916bd. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 656.682969] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-ea692a03-b680-4082-a4d3-36b28076ef4d tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] [instance: 306f3cb9-3028-4ff2-8090-2c9c1c72efc1] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53002) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 656.683523] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-ea692a03-b680-4082-a4d3-36b28076ef4d tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 656.683744] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-ea692a03-b680-4082-a4d3-36b28076ef4d tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 656.684052] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-ea692a03-b680-4082-a4d3-36b28076ef4d tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 656.687987] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-ea692a03-b680-4082-a4d3-36b28076ef4d tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] [instance: 306f3cb9-3028-4ff2-8090-2c9c1c72efc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 656.688821] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-ea692a03-b680-4082-a4d3-36b28076ef4d tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 656.689117] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-ea692a03-b680-4082-a4d3-36b28076ef4d tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 656.689363] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-ea692a03-b680-4082-a4d3-36b28076ef4d tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 656.730255] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-ea692a03-b680-4082-a4d3-36b28076ef4d tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 656.730529] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-ea692a03-b680-4082-a4d3-36b28076ef4d tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 656.730712] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-ea692a03-b680-4082-a4d3-36b28076ef4d tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 657.122684] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-0cce2017-52b4-498d-9162-f2d06a7fc921 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Took 0.18 seconds to select destinations for 1 instance(s). {{(pid=53001) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 657.138984] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0cce2017-52b4-498d-9162-f2d06a7fc921 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 657.139144] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0cce2017-52b4-498d-9162-f2d06a7fc921 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 657.139235] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0cce2017-52b4-498d-9162-f2d06a7fc921 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 657.192392] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0cce2017-52b4-498d-9162-f2d06a7fc921 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 657.192620] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0cce2017-52b4-498d-9162-f2d06a7fc921 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 657.192791] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0cce2017-52b4-498d-9162-f2d06a7fc921 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 657.193208] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0cce2017-52b4-498d-9162-f2d06a7fc921 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 657.193407] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0cce2017-52b4-498d-9162-f2d06a7fc921 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 657.193573] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0cce2017-52b4-498d-9162-f2d06a7fc921 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 657.206611] nova-conductor[53001]: DEBUG nova.quota [None req-0cce2017-52b4-498d-9162-f2d06a7fc921 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Getting quotas for project 75b9fd168b9c45a8a4d2f7508844570f. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 657.210241] nova-conductor[53001]: DEBUG nova.quota [None req-0cce2017-52b4-498d-9162-f2d06a7fc921 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Getting quotas for user d6b334eabb2a43d6b5c76c16a022591e and project 75b9fd168b9c45a8a4d2f7508844570f. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 657.218513] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-0cce2017-52b4-498d-9162-f2d06a7fc921 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] [instance: 46737200-2da8-41ee-b33e-3bb6cc3e4618] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53001) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 657.219024] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0cce2017-52b4-498d-9162-f2d06a7fc921 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 657.219245] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0cce2017-52b4-498d-9162-f2d06a7fc921 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 657.219424] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0cce2017-52b4-498d-9162-f2d06a7fc921 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 657.225824] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-0cce2017-52b4-498d-9162-f2d06a7fc921 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] [instance: 46737200-2da8-41ee-b33e-3bb6cc3e4618] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 657.226793] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0cce2017-52b4-498d-9162-f2d06a7fc921 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 657.227281] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0cce2017-52b4-498d-9162-f2d06a7fc921 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 657.227937] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0cce2017-52b4-498d-9162-f2d06a7fc921 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 657.246822] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0cce2017-52b4-498d-9162-f2d06a7fc921 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 657.247057] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0cce2017-52b4-498d-9162-f2d06a7fc921 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 657.247251] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-0cce2017-52b4-498d-9162-f2d06a7fc921 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 662.519883] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-348fc44a-8435-47bd-86c7-d1c4bfe70069 tempest-ServerGroupTestJSON-1519550876 tempest-ServerGroupTestJSON-1519550876-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 662.521189] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-348fc44a-8435-47bd-86c7-d1c4bfe70069 tempest-ServerGroupTestJSON-1519550876 tempest-ServerGroupTestJSON-1519550876-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 662.521460] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-348fc44a-8435-47bd-86c7-d1c4bfe70069 tempest-ServerGroupTestJSON-1519550876 tempest-ServerGroupTestJSON-1519550876-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 662.889052] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-348fc44a-8435-47bd-86c7-d1c4bfe70069 tempest-ServerGroupTestJSON-1519550876 tempest-ServerGroupTestJSON-1519550876-project-member] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=53002) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 662.904510] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-348fc44a-8435-47bd-86c7-d1c4bfe70069 tempest-ServerGroupTestJSON-1519550876 tempest-ServerGroupTestJSON-1519550876-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 662.904752] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-348fc44a-8435-47bd-86c7-d1c4bfe70069 tempest-ServerGroupTestJSON-1519550876 tempest-ServerGroupTestJSON-1519550876-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 662.904925] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-348fc44a-8435-47bd-86c7-d1c4bfe70069 tempest-ServerGroupTestJSON-1519550876 tempest-ServerGroupTestJSON-1519550876-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 662.993317] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-348fc44a-8435-47bd-86c7-d1c4bfe70069 tempest-ServerGroupTestJSON-1519550876 tempest-ServerGroupTestJSON-1519550876-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 662.993632] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-348fc44a-8435-47bd-86c7-d1c4bfe70069 tempest-ServerGroupTestJSON-1519550876 tempest-ServerGroupTestJSON-1519550876-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 662.993806] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-348fc44a-8435-47bd-86c7-d1c4bfe70069 tempest-ServerGroupTestJSON-1519550876 tempest-ServerGroupTestJSON-1519550876-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 662.994251] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-348fc44a-8435-47bd-86c7-d1c4bfe70069 tempest-ServerGroupTestJSON-1519550876 tempest-ServerGroupTestJSON-1519550876-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 662.994472] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-348fc44a-8435-47bd-86c7-d1c4bfe70069 tempest-ServerGroupTestJSON-1519550876 tempest-ServerGroupTestJSON-1519550876-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 662.994669] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-348fc44a-8435-47bd-86c7-d1c4bfe70069 tempest-ServerGroupTestJSON-1519550876 tempest-ServerGroupTestJSON-1519550876-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 663.007295] nova-conductor[53002]: DEBUG nova.quota [None req-348fc44a-8435-47bd-86c7-d1c4bfe70069 tempest-ServerGroupTestJSON-1519550876 tempest-ServerGroupTestJSON-1519550876-project-member] Getting quotas for project e1b61c42902e4ab48c30c1e4b65dc169. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 663.007746] nova-conductor[53002]: DEBUG nova.quota [None req-348fc44a-8435-47bd-86c7-d1c4bfe70069 tempest-ServerGroupTestJSON-1519550876 tempest-ServerGroupTestJSON-1519550876-project-member] Getting quotas for user 887300ba477a4a609b203656399d428e and project e1b61c42902e4ab48c30c1e4b65dc169. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 663.014035] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-348fc44a-8435-47bd-86c7-d1c4bfe70069 tempest-ServerGroupTestJSON-1519550876 tempest-ServerGroupTestJSON-1519550876-project-member] [instance: 67cbaf5c-e743-4e07-8f74-c51e4f57914d] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53002) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 663.014697] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-348fc44a-8435-47bd-86c7-d1c4bfe70069 tempest-ServerGroupTestJSON-1519550876 tempest-ServerGroupTestJSON-1519550876-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 663.014930] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-348fc44a-8435-47bd-86c7-d1c4bfe70069 tempest-ServerGroupTestJSON-1519550876 tempest-ServerGroupTestJSON-1519550876-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 663.015286] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-348fc44a-8435-47bd-86c7-d1c4bfe70069 tempest-ServerGroupTestJSON-1519550876 tempest-ServerGroupTestJSON-1519550876-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 663.020256] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-348fc44a-8435-47bd-86c7-d1c4bfe70069 tempest-ServerGroupTestJSON-1519550876 tempest-ServerGroupTestJSON-1519550876-project-member] [instance: 67cbaf5c-e743-4e07-8f74-c51e4f57914d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 663.021029] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-348fc44a-8435-47bd-86c7-d1c4bfe70069 tempest-ServerGroupTestJSON-1519550876 tempest-ServerGroupTestJSON-1519550876-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 663.021244] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-348fc44a-8435-47bd-86c7-d1c4bfe70069 tempest-ServerGroupTestJSON-1519550876 tempest-ServerGroupTestJSON-1519550876-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 663.021417] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-348fc44a-8435-47bd-86c7-d1c4bfe70069 tempest-ServerGroupTestJSON-1519550876 tempest-ServerGroupTestJSON-1519550876-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 663.061831] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-348fc44a-8435-47bd-86c7-d1c4bfe70069 tempest-ServerGroupTestJSON-1519550876 tempest-ServerGroupTestJSON-1519550876-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 663.062338] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-348fc44a-8435-47bd-86c7-d1c4bfe70069 tempest-ServerGroupTestJSON-1519550876 tempest-ServerGroupTestJSON-1519550876-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 663.062593] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-348fc44a-8435-47bd-86c7-d1c4bfe70069 tempest-ServerGroupTestJSON-1519550876 tempest-ServerGroupTestJSON-1519550876-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 664.156275] nova-conductor[53002]: ERROR nova.scheduler.utils [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] [instance: 31e48a76-ffbc-4bd2-a01f-2a69df2de5f5] Error from last host: cpu-1 (node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28): ['Traceback (most recent call last):\n', ' File "/opt/stack/nova/nova/compute/manager.py", line 2611, in _build_and_run_instance\n self.driver.spawn(context, instance, image_meta,\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/driver.py", line 529, in spawn\n self._vmops.spawn(context, instance, image_meta, injected_files,\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 786, in spawn\n self._fetch_image_if_missing(context, vi)\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 639, in _fetch_image_if_missing\n image_cache(vi, tmp_image_ds_loc)\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 537, in _cache_sparse_image\n vm_util.copy_virtual_disk(\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vm_util.py", line 1423, in copy_virtual_disk\n session._wait_for_task(vmdk_copy_task)\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/session.py", line 157, in _wait_for_task\n return self.wait_for_task(task_ref)\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_vmware/api.py", line 398, in wait_for_task\n return evt.wait()\n', ' File "/usr/local/lib/python3.10/dist-packages/eventlet/event.py", line 125, in wait\n result = hub.switch()\n', ' File "/usr/local/lib/python3.10/dist-packages/eventlet/hubs/hub.py", line 313, in switch\n return self.greenlet.switch()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_vmware/common/loopingcall.py", line 75, in _inner\n self.f(*self.args, **self.kw)\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_vmware/api.py", line 448, in _poll_task\n raise exceptions.translate_fault(task_info.error)\n', "oslo_vmware.exceptions.VimFaultException: A specified parameter was not correct: fileType\nFaults: ['InvalidArgument']\n", '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', ' File "/opt/stack/nova/nova/compute/manager.py", line 2426, in _do_build_and_run_instance\n self._build_and_run_instance(context, instance, image,\n', ' File "/opt/stack/nova/nova/compute/manager.py", line 2718, in _build_and_run_instance\n raise exception.RescheduledException(\n', "nova.exception.RescheduledException: Build of instance 31e48a76-ffbc-4bd2-a01f-2a69df2de5f5 was re-scheduled: A specified parameter was not correct: fileType\nFaults: ['InvalidArgument']\n"] [ 664.157632] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] Rescheduling: True {{(pid=53002) build_instances /opt/stack/nova/nova/conductor/manager.py:695}} [ 664.158468] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] Failed to compute_task_build_instances: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 31e48a76-ffbc-4bd2-a01f-2a69df2de5f5.: nova.exception.MaxRetriesExceeded: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 31e48a76-ffbc-4bd2-a01f-2a69df2de5f5. [ 664.158896] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] [instance: 31e48a76-ffbc-4bd2-a01f-2a69df2de5f5] Setting instance to ERROR state.: nova.exception.MaxRetriesExceeded: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 31e48a76-ffbc-4bd2-a01f-2a69df2de5f5. [ 664.204586] nova-conductor[53002]: DEBUG nova.network.neutron [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] [instance: 31e48a76-ffbc-4bd2-a01f-2a69df2de5f5] deallocate_for_instance() {{(pid=53002) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1803}} [ 664.476644] nova-conductor[53002]: DEBUG nova.network.neutron [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] [instance: 31e48a76-ffbc-4bd2-a01f-2a69df2de5f5] Instance cache missing network info. {{(pid=53002) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3323}} [ 664.486037] nova-conductor[53002]: DEBUG nova.network.neutron [None req-ba8c1356-2ffa-46df-bfce-69b3b7c417f2 tempest-ServerDiagnosticsTest-533831989 tempest-ServerDiagnosticsTest-533831989-project-member] [instance: 31e48a76-ffbc-4bd2-a01f-2a69df2de5f5] Updating instance_info_cache with network_info: [] {{(pid=53002) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} [ 665.295925] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-85a6e488-4ff9-4b22-885a-af1c2c6ff65c tempest-ImagesNegativeTestJSON-1588877586 tempest-ImagesNegativeTestJSON-1588877586-project-member] Took 0.17 seconds to select destinations for 1 instance(s). {{(pid=53002) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 665.316353] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-85a6e488-4ff9-4b22-885a-af1c2c6ff65c tempest-ImagesNegativeTestJSON-1588877586 tempest-ImagesNegativeTestJSON-1588877586-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 665.316353] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-85a6e488-4ff9-4b22-885a-af1c2c6ff65c tempest-ImagesNegativeTestJSON-1588877586 tempest-ImagesNegativeTestJSON-1588877586-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 665.316353] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-85a6e488-4ff9-4b22-885a-af1c2c6ff65c tempest-ImagesNegativeTestJSON-1588877586 tempest-ImagesNegativeTestJSON-1588877586-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 665.411549] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-85a6e488-4ff9-4b22-885a-af1c2c6ff65c tempest-ImagesNegativeTestJSON-1588877586 tempest-ImagesNegativeTestJSON-1588877586-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 665.411707] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-85a6e488-4ff9-4b22-885a-af1c2c6ff65c tempest-ImagesNegativeTestJSON-1588877586 tempest-ImagesNegativeTestJSON-1588877586-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 665.411805] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-85a6e488-4ff9-4b22-885a-af1c2c6ff65c tempest-ImagesNegativeTestJSON-1588877586 tempest-ImagesNegativeTestJSON-1588877586-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 665.412196] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-85a6e488-4ff9-4b22-885a-af1c2c6ff65c tempest-ImagesNegativeTestJSON-1588877586 tempest-ImagesNegativeTestJSON-1588877586-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 665.412394] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-85a6e488-4ff9-4b22-885a-af1c2c6ff65c tempest-ImagesNegativeTestJSON-1588877586 tempest-ImagesNegativeTestJSON-1588877586-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 665.412560] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-85a6e488-4ff9-4b22-885a-af1c2c6ff65c tempest-ImagesNegativeTestJSON-1588877586 tempest-ImagesNegativeTestJSON-1588877586-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 665.422443] nova-conductor[53002]: DEBUG nova.quota [None req-85a6e488-4ff9-4b22-885a-af1c2c6ff65c tempest-ImagesNegativeTestJSON-1588877586 tempest-ImagesNegativeTestJSON-1588877586-project-member] Getting quotas for project a43bd29c3e8a4be6bfe9cbc12cf4c9a8. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 665.425152] nova-conductor[53002]: DEBUG nova.quota [None req-85a6e488-4ff9-4b22-885a-af1c2c6ff65c tempest-ImagesNegativeTestJSON-1588877586 tempest-ImagesNegativeTestJSON-1588877586-project-member] Getting quotas for user daf8a085e5194bfc92a5d185789a92da and project a43bd29c3e8a4be6bfe9cbc12cf4c9a8. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 665.435193] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-85a6e488-4ff9-4b22-885a-af1c2c6ff65c tempest-ImagesNegativeTestJSON-1588877586 tempest-ImagesNegativeTestJSON-1588877586-project-member] [instance: 6774e2f5-99d0-4dc9-9ac0-188b35bd68a2] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53002) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 665.435193] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-85a6e488-4ff9-4b22-885a-af1c2c6ff65c tempest-ImagesNegativeTestJSON-1588877586 tempest-ImagesNegativeTestJSON-1588877586-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 665.435193] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-85a6e488-4ff9-4b22-885a-af1c2c6ff65c tempest-ImagesNegativeTestJSON-1588877586 tempest-ImagesNegativeTestJSON-1588877586-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 665.435193] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-85a6e488-4ff9-4b22-885a-af1c2c6ff65c tempest-ImagesNegativeTestJSON-1588877586 tempest-ImagesNegativeTestJSON-1588877586-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 665.442287] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-85a6e488-4ff9-4b22-885a-af1c2c6ff65c tempest-ImagesNegativeTestJSON-1588877586 tempest-ImagesNegativeTestJSON-1588877586-project-member] [instance: 6774e2f5-99d0-4dc9-9ac0-188b35bd68a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 665.443208] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-85a6e488-4ff9-4b22-885a-af1c2c6ff65c tempest-ImagesNegativeTestJSON-1588877586 tempest-ImagesNegativeTestJSON-1588877586-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 665.443374] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-85a6e488-4ff9-4b22-885a-af1c2c6ff65c tempest-ImagesNegativeTestJSON-1588877586 tempest-ImagesNegativeTestJSON-1588877586-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 665.443598] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-85a6e488-4ff9-4b22-885a-af1c2c6ff65c tempest-ImagesNegativeTestJSON-1588877586 tempest-ImagesNegativeTestJSON-1588877586-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 665.475293] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-85a6e488-4ff9-4b22-885a-af1c2c6ff65c tempest-ImagesNegativeTestJSON-1588877586 tempest-ImagesNegativeTestJSON-1588877586-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 665.475533] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-85a6e488-4ff9-4b22-885a-af1c2c6ff65c tempest-ImagesNegativeTestJSON-1588877586 tempest-ImagesNegativeTestJSON-1588877586-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 665.475709] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-85a6e488-4ff9-4b22-885a-af1c2c6ff65c tempest-ImagesNegativeTestJSON-1588877586 tempest-ImagesNegativeTestJSON-1588877586-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 665.788397] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-adf07f4a-3bca-41f2-9a5f-debef055977c tempest-ServersNegativeTestMultiTenantJSON-819000951 tempest-ServersNegativeTestMultiTenantJSON-819000951-project-member] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=53001) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 665.804852] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-adf07f4a-3bca-41f2-9a5f-debef055977c tempest-ServersNegativeTestMultiTenantJSON-819000951 tempest-ServersNegativeTestMultiTenantJSON-819000951-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 665.805180] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-adf07f4a-3bca-41f2-9a5f-debef055977c tempest-ServersNegativeTestMultiTenantJSON-819000951 tempest-ServersNegativeTestMultiTenantJSON-819000951-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 665.805636] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-adf07f4a-3bca-41f2-9a5f-debef055977c tempest-ServersNegativeTestMultiTenantJSON-819000951 tempest-ServersNegativeTestMultiTenantJSON-819000951-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 665.876777] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-adf07f4a-3bca-41f2-9a5f-debef055977c tempest-ServersNegativeTestMultiTenantJSON-819000951 tempest-ServersNegativeTestMultiTenantJSON-819000951-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 665.877852] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-adf07f4a-3bca-41f2-9a5f-debef055977c tempest-ServersNegativeTestMultiTenantJSON-819000951 tempest-ServersNegativeTestMultiTenantJSON-819000951-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 665.878150] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-adf07f4a-3bca-41f2-9a5f-debef055977c tempest-ServersNegativeTestMultiTenantJSON-819000951 tempest-ServersNegativeTestMultiTenantJSON-819000951-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 665.878581] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-adf07f4a-3bca-41f2-9a5f-debef055977c tempest-ServersNegativeTestMultiTenantJSON-819000951 tempest-ServersNegativeTestMultiTenantJSON-819000951-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 665.878796] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-adf07f4a-3bca-41f2-9a5f-debef055977c tempest-ServersNegativeTestMultiTenantJSON-819000951 tempest-ServersNegativeTestMultiTenantJSON-819000951-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 665.878967] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-adf07f4a-3bca-41f2-9a5f-debef055977c tempest-ServersNegativeTestMultiTenantJSON-819000951 tempest-ServersNegativeTestMultiTenantJSON-819000951-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 665.889891] nova-conductor[53001]: DEBUG nova.quota [None req-adf07f4a-3bca-41f2-9a5f-debef055977c tempest-ServersNegativeTestMultiTenantJSON-819000951 tempest-ServersNegativeTestMultiTenantJSON-819000951-project-member] Getting quotas for project 2758c6e2540b46f9bf470983214db153. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 665.892621] nova-conductor[53001]: DEBUG nova.quota [None req-adf07f4a-3bca-41f2-9a5f-debef055977c tempest-ServersNegativeTestMultiTenantJSON-819000951 tempest-ServersNegativeTestMultiTenantJSON-819000951-project-member] Getting quotas for user 7a316402420d40889b6c371838f68ba1 and project 2758c6e2540b46f9bf470983214db153. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 665.900983] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-adf07f4a-3bca-41f2-9a5f-debef055977c tempest-ServersNegativeTestMultiTenantJSON-819000951 tempest-ServersNegativeTestMultiTenantJSON-819000951-project-member] [instance: a878722d-7e36-4f15-8c5f-bd473375dd9b] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53001) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 665.901755] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-adf07f4a-3bca-41f2-9a5f-debef055977c tempest-ServersNegativeTestMultiTenantJSON-819000951 tempest-ServersNegativeTestMultiTenantJSON-819000951-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 665.901980] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-adf07f4a-3bca-41f2-9a5f-debef055977c tempest-ServersNegativeTestMultiTenantJSON-819000951 tempest-ServersNegativeTestMultiTenantJSON-819000951-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 665.902241] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-adf07f4a-3bca-41f2-9a5f-debef055977c tempest-ServersNegativeTestMultiTenantJSON-819000951 tempest-ServersNegativeTestMultiTenantJSON-819000951-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 665.907902] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-adf07f4a-3bca-41f2-9a5f-debef055977c tempest-ServersNegativeTestMultiTenantJSON-819000951 tempest-ServersNegativeTestMultiTenantJSON-819000951-project-member] [instance: a878722d-7e36-4f15-8c5f-bd473375dd9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 665.908846] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-adf07f4a-3bca-41f2-9a5f-debef055977c tempest-ServersNegativeTestMultiTenantJSON-819000951 tempest-ServersNegativeTestMultiTenantJSON-819000951-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 665.909160] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-adf07f4a-3bca-41f2-9a5f-debef055977c tempest-ServersNegativeTestMultiTenantJSON-819000951 tempest-ServersNegativeTestMultiTenantJSON-819000951-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 665.909352] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-adf07f4a-3bca-41f2-9a5f-debef055977c tempest-ServersNegativeTestMultiTenantJSON-819000951 tempest-ServersNegativeTestMultiTenantJSON-819000951-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 665.930848] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-adf07f4a-3bca-41f2-9a5f-debef055977c tempest-ServersNegativeTestMultiTenantJSON-819000951 tempest-ServersNegativeTestMultiTenantJSON-819000951-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 665.931119] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-adf07f4a-3bca-41f2-9a5f-debef055977c tempest-ServersNegativeTestMultiTenantJSON-819000951 tempest-ServersNegativeTestMultiTenantJSON-819000951-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 665.931302] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-adf07f4a-3bca-41f2-9a5f-debef055977c tempest-ServersNegativeTestMultiTenantJSON-819000951 tempest-ServersNegativeTestMultiTenantJSON-819000951-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 666.602886] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-e5837970-1bd9-42cd-9028-3a8d80878924 tempest-ServerMetadataNegativeTestJSON-2122666783 tempest-ServerMetadataNegativeTestJSON-2122666783-project-member] Took 0.16 seconds to select destinations for 1 instance(s). {{(pid=53002) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 666.620483] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e5837970-1bd9-42cd-9028-3a8d80878924 tempest-ServerMetadataNegativeTestJSON-2122666783 tempest-ServerMetadataNegativeTestJSON-2122666783-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 666.620754] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e5837970-1bd9-42cd-9028-3a8d80878924 tempest-ServerMetadataNegativeTestJSON-2122666783 tempest-ServerMetadataNegativeTestJSON-2122666783-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 666.620943] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e5837970-1bd9-42cd-9028-3a8d80878924 tempest-ServerMetadataNegativeTestJSON-2122666783 tempest-ServerMetadataNegativeTestJSON-2122666783-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 666.674359] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e5837970-1bd9-42cd-9028-3a8d80878924 tempest-ServerMetadataNegativeTestJSON-2122666783 tempest-ServerMetadataNegativeTestJSON-2122666783-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 666.674959] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e5837970-1bd9-42cd-9028-3a8d80878924 tempest-ServerMetadataNegativeTestJSON-2122666783 tempest-ServerMetadataNegativeTestJSON-2122666783-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 666.675374] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e5837970-1bd9-42cd-9028-3a8d80878924 tempest-ServerMetadataNegativeTestJSON-2122666783 tempest-ServerMetadataNegativeTestJSON-2122666783-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 666.675992] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e5837970-1bd9-42cd-9028-3a8d80878924 tempest-ServerMetadataNegativeTestJSON-2122666783 tempest-ServerMetadataNegativeTestJSON-2122666783-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 666.677158] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e5837970-1bd9-42cd-9028-3a8d80878924 tempest-ServerMetadataNegativeTestJSON-2122666783 tempest-ServerMetadataNegativeTestJSON-2122666783-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 666.677158] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e5837970-1bd9-42cd-9028-3a8d80878924 tempest-ServerMetadataNegativeTestJSON-2122666783 tempest-ServerMetadataNegativeTestJSON-2122666783-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 666.687583] nova-conductor[53002]: DEBUG nova.quota [None req-e5837970-1bd9-42cd-9028-3a8d80878924 tempest-ServerMetadataNegativeTestJSON-2122666783 tempest-ServerMetadataNegativeTestJSON-2122666783-project-member] Getting quotas for project 1d15d5cfcac04661bc0b009b30cd2b72. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 666.690711] nova-conductor[53002]: DEBUG nova.quota [None req-e5837970-1bd9-42cd-9028-3a8d80878924 tempest-ServerMetadataNegativeTestJSON-2122666783 tempest-ServerMetadataNegativeTestJSON-2122666783-project-member] Getting quotas for user 9c82a7a0ccf44691b51a91fededc6f56 and project 1d15d5cfcac04661bc0b009b30cd2b72. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 666.697916] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-e5837970-1bd9-42cd-9028-3a8d80878924 tempest-ServerMetadataNegativeTestJSON-2122666783 tempest-ServerMetadataNegativeTestJSON-2122666783-project-member] [instance: deffd52b-d708-4c46-a168-18e80b05b133] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53002) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 666.698565] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e5837970-1bd9-42cd-9028-3a8d80878924 tempest-ServerMetadataNegativeTestJSON-2122666783 tempest-ServerMetadataNegativeTestJSON-2122666783-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 666.698832] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e5837970-1bd9-42cd-9028-3a8d80878924 tempest-ServerMetadataNegativeTestJSON-2122666783 tempest-ServerMetadataNegativeTestJSON-2122666783-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 666.699059] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e5837970-1bd9-42cd-9028-3a8d80878924 tempest-ServerMetadataNegativeTestJSON-2122666783 tempest-ServerMetadataNegativeTestJSON-2122666783-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 666.702334] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-e5837970-1bd9-42cd-9028-3a8d80878924 tempest-ServerMetadataNegativeTestJSON-2122666783 tempest-ServerMetadataNegativeTestJSON-2122666783-project-member] [instance: deffd52b-d708-4c46-a168-18e80b05b133] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 666.703600] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e5837970-1bd9-42cd-9028-3a8d80878924 tempest-ServerMetadataNegativeTestJSON-2122666783 tempest-ServerMetadataNegativeTestJSON-2122666783-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 666.703933] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e5837970-1bd9-42cd-9028-3a8d80878924 tempest-ServerMetadataNegativeTestJSON-2122666783 tempest-ServerMetadataNegativeTestJSON-2122666783-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 666.704047] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e5837970-1bd9-42cd-9028-3a8d80878924 tempest-ServerMetadataNegativeTestJSON-2122666783 tempest-ServerMetadataNegativeTestJSON-2122666783-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 666.721733] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e5837970-1bd9-42cd-9028-3a8d80878924 tempest-ServerMetadataNegativeTestJSON-2122666783 tempest-ServerMetadataNegativeTestJSON-2122666783-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 666.721733] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e5837970-1bd9-42cd-9028-3a8d80878924 tempest-ServerMetadataNegativeTestJSON-2122666783 tempest-ServerMetadataNegativeTestJSON-2122666783-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 666.721733] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e5837970-1bd9-42cd-9028-3a8d80878924 tempest-ServerMetadataNegativeTestJSON-2122666783 tempest-ServerMetadataNegativeTestJSON-2122666783-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 669.923965] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-34948935-a815-4d21-8ed3-ddfac054bc11 tempest-ServerTagsTestJSON-1582888721 tempest-ServerTagsTestJSON-1582888721-project-member] Took 0.14 seconds to select destinations for 1 instance(s). {{(pid=53002) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 669.936360] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-34948935-a815-4d21-8ed3-ddfac054bc11 tempest-ServerTagsTestJSON-1582888721 tempest-ServerTagsTestJSON-1582888721-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 669.936360] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-34948935-a815-4d21-8ed3-ddfac054bc11 tempest-ServerTagsTestJSON-1582888721 tempest-ServerTagsTestJSON-1582888721-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 669.936360] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-34948935-a815-4d21-8ed3-ddfac054bc11 tempest-ServerTagsTestJSON-1582888721 tempest-ServerTagsTestJSON-1582888721-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 669.974529] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-34948935-a815-4d21-8ed3-ddfac054bc11 tempest-ServerTagsTestJSON-1582888721 tempest-ServerTagsTestJSON-1582888721-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 669.974788] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-34948935-a815-4d21-8ed3-ddfac054bc11 tempest-ServerTagsTestJSON-1582888721 tempest-ServerTagsTestJSON-1582888721-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 669.974941] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-34948935-a815-4d21-8ed3-ddfac054bc11 tempest-ServerTagsTestJSON-1582888721 tempest-ServerTagsTestJSON-1582888721-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 669.975361] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-34948935-a815-4d21-8ed3-ddfac054bc11 tempest-ServerTagsTestJSON-1582888721 tempest-ServerTagsTestJSON-1582888721-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 669.975562] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-34948935-a815-4d21-8ed3-ddfac054bc11 tempest-ServerTagsTestJSON-1582888721 tempest-ServerTagsTestJSON-1582888721-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 669.975727] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-34948935-a815-4d21-8ed3-ddfac054bc11 tempest-ServerTagsTestJSON-1582888721 tempest-ServerTagsTestJSON-1582888721-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 669.985998] nova-conductor[53002]: DEBUG nova.quota [None req-34948935-a815-4d21-8ed3-ddfac054bc11 tempest-ServerTagsTestJSON-1582888721 tempest-ServerTagsTestJSON-1582888721-project-member] Getting quotas for project 5059e7e75617425bb379ef3cc095137e. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 669.990800] nova-conductor[53002]: DEBUG nova.quota [None req-34948935-a815-4d21-8ed3-ddfac054bc11 tempest-ServerTagsTestJSON-1582888721 tempest-ServerTagsTestJSON-1582888721-project-member] Getting quotas for user 24953a27d2c447578a1cb3e4523acb03 and project 5059e7e75617425bb379ef3cc095137e. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 669.997493] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-34948935-a815-4d21-8ed3-ddfac054bc11 tempest-ServerTagsTestJSON-1582888721 tempest-ServerTagsTestJSON-1582888721-project-member] [instance: bf1694f2-6ad0-4e15-b05d-c73c24e0e955] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53002) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 669.998011] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-34948935-a815-4d21-8ed3-ddfac054bc11 tempest-ServerTagsTestJSON-1582888721 tempest-ServerTagsTestJSON-1582888721-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 669.998233] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-34948935-a815-4d21-8ed3-ddfac054bc11 tempest-ServerTagsTestJSON-1582888721 tempest-ServerTagsTestJSON-1582888721-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 669.998411] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-34948935-a815-4d21-8ed3-ddfac054bc11 tempest-ServerTagsTestJSON-1582888721 tempest-ServerTagsTestJSON-1582888721-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 670.002710] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-34948935-a815-4d21-8ed3-ddfac054bc11 tempest-ServerTagsTestJSON-1582888721 tempest-ServerTagsTestJSON-1582888721-project-member] [instance: bf1694f2-6ad0-4e15-b05d-c73c24e0e955] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 670.003432] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-34948935-a815-4d21-8ed3-ddfac054bc11 tempest-ServerTagsTestJSON-1582888721 tempest-ServerTagsTestJSON-1582888721-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 670.003633] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-34948935-a815-4d21-8ed3-ddfac054bc11 tempest-ServerTagsTestJSON-1582888721 tempest-ServerTagsTestJSON-1582888721-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 670.003803] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-34948935-a815-4d21-8ed3-ddfac054bc11 tempest-ServerTagsTestJSON-1582888721 tempest-ServerTagsTestJSON-1582888721-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 670.022746] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-34948935-a815-4d21-8ed3-ddfac054bc11 tempest-ServerTagsTestJSON-1582888721 tempest-ServerTagsTestJSON-1582888721-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 670.022890] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-34948935-a815-4d21-8ed3-ddfac054bc11 tempest-ServerTagsTestJSON-1582888721 tempest-ServerTagsTestJSON-1582888721-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 670.023080] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-34948935-a815-4d21-8ed3-ddfac054bc11 tempest-ServerTagsTestJSON-1582888721 tempest-ServerTagsTestJSON-1582888721-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 670.255498] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-7c9a00f6-9343-4899-83da-79ed712f6304 tempest-ServerActionsTestOtherB-1079721433 tempest-ServerActionsTestOtherB-1079721433-project-member] Took 0.16 seconds to select destinations for 1 instance(s). {{(pid=53001) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 670.273273] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7c9a00f6-9343-4899-83da-79ed712f6304 tempest-ServerActionsTestOtherB-1079721433 tempest-ServerActionsTestOtherB-1079721433-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 670.273556] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7c9a00f6-9343-4899-83da-79ed712f6304 tempest-ServerActionsTestOtherB-1079721433 tempest-ServerActionsTestOtherB-1079721433-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 670.273738] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7c9a00f6-9343-4899-83da-79ed712f6304 tempest-ServerActionsTestOtherB-1079721433 tempest-ServerActionsTestOtherB-1079721433-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 670.317109] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7c9a00f6-9343-4899-83da-79ed712f6304 tempest-ServerActionsTestOtherB-1079721433 tempest-ServerActionsTestOtherB-1079721433-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 670.317447] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7c9a00f6-9343-4899-83da-79ed712f6304 tempest-ServerActionsTestOtherB-1079721433 tempest-ServerActionsTestOtherB-1079721433-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 670.317543] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7c9a00f6-9343-4899-83da-79ed712f6304 tempest-ServerActionsTestOtherB-1079721433 tempest-ServerActionsTestOtherB-1079721433-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 670.317913] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7c9a00f6-9343-4899-83da-79ed712f6304 tempest-ServerActionsTestOtherB-1079721433 tempest-ServerActionsTestOtherB-1079721433-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 670.318113] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7c9a00f6-9343-4899-83da-79ed712f6304 tempest-ServerActionsTestOtherB-1079721433 tempest-ServerActionsTestOtherB-1079721433-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 670.318283] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7c9a00f6-9343-4899-83da-79ed712f6304 tempest-ServerActionsTestOtherB-1079721433 tempest-ServerActionsTestOtherB-1079721433-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 670.333651] nova-conductor[53001]: DEBUG nova.quota [None req-7c9a00f6-9343-4899-83da-79ed712f6304 tempest-ServerActionsTestOtherB-1079721433 tempest-ServerActionsTestOtherB-1079721433-project-member] Getting quotas for project e0504af7ee354055a30f9c1406637851. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 670.336208] nova-conductor[53001]: DEBUG nova.quota [None req-7c9a00f6-9343-4899-83da-79ed712f6304 tempest-ServerActionsTestOtherB-1079721433 tempest-ServerActionsTestOtherB-1079721433-project-member] Getting quotas for user 8ca896bc1ad84bf898e09ce47b0a5a43 and project e0504af7ee354055a30f9c1406637851. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 670.345713] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-7c9a00f6-9343-4899-83da-79ed712f6304 tempest-ServerActionsTestOtherB-1079721433 tempest-ServerActionsTestOtherB-1079721433-project-member] [instance: ecc4262d-6133-4541-aec8-fbee05180701] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53001) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 670.346305] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7c9a00f6-9343-4899-83da-79ed712f6304 tempest-ServerActionsTestOtherB-1079721433 tempest-ServerActionsTestOtherB-1079721433-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 670.346533] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7c9a00f6-9343-4899-83da-79ed712f6304 tempest-ServerActionsTestOtherB-1079721433 tempest-ServerActionsTestOtherB-1079721433-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 670.346709] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7c9a00f6-9343-4899-83da-79ed712f6304 tempest-ServerActionsTestOtherB-1079721433 tempest-ServerActionsTestOtherB-1079721433-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 670.350150] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-7c9a00f6-9343-4899-83da-79ed712f6304 tempest-ServerActionsTestOtherB-1079721433 tempest-ServerActionsTestOtherB-1079721433-project-member] [instance: ecc4262d-6133-4541-aec8-fbee05180701] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 670.350829] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7c9a00f6-9343-4899-83da-79ed712f6304 tempest-ServerActionsTestOtherB-1079721433 tempest-ServerActionsTestOtherB-1079721433-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 670.351062] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7c9a00f6-9343-4899-83da-79ed712f6304 tempest-ServerActionsTestOtherB-1079721433 tempest-ServerActionsTestOtherB-1079721433-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 670.351242] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7c9a00f6-9343-4899-83da-79ed712f6304 tempest-ServerActionsTestOtherB-1079721433 tempest-ServerActionsTestOtherB-1079721433-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 670.369661] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7c9a00f6-9343-4899-83da-79ed712f6304 tempest-ServerActionsTestOtherB-1079721433 tempest-ServerActionsTestOtherB-1079721433-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 670.369758] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7c9a00f6-9343-4899-83da-79ed712f6304 tempest-ServerActionsTestOtherB-1079721433 tempest-ServerActionsTestOtherB-1079721433-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 670.369935] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7c9a00f6-9343-4899-83da-79ed712f6304 tempest-ServerActionsTestOtherB-1079721433 tempest-ServerActionsTestOtherB-1079721433-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 678.206022] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-eb5badd8-d0c4-4998-b0c5-30e887803cef tempest-ServerActionsV293TestJSON-390462293 tempest-ServerActionsV293TestJSON-390462293-project-member] Took 0.18 seconds to select destinations for 1 instance(s). {{(pid=53002) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 678.216371] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb5badd8-d0c4-4998-b0c5-30e887803cef tempest-ServerActionsV293TestJSON-390462293 tempest-ServerActionsV293TestJSON-390462293-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 678.216610] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb5badd8-d0c4-4998-b0c5-30e887803cef tempest-ServerActionsV293TestJSON-390462293 tempest-ServerActionsV293TestJSON-390462293-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 678.216787] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb5badd8-d0c4-4998-b0c5-30e887803cef tempest-ServerActionsV293TestJSON-390462293 tempest-ServerActionsV293TestJSON-390462293-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 678.254429] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb5badd8-d0c4-4998-b0c5-30e887803cef tempest-ServerActionsV293TestJSON-390462293 tempest-ServerActionsV293TestJSON-390462293-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 678.254669] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb5badd8-d0c4-4998-b0c5-30e887803cef tempest-ServerActionsV293TestJSON-390462293 tempest-ServerActionsV293TestJSON-390462293-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 678.254847] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb5badd8-d0c4-4998-b0c5-30e887803cef tempest-ServerActionsV293TestJSON-390462293 tempest-ServerActionsV293TestJSON-390462293-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 678.255628] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb5badd8-d0c4-4998-b0c5-30e887803cef tempest-ServerActionsV293TestJSON-390462293 tempest-ServerActionsV293TestJSON-390462293-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 678.255628] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb5badd8-d0c4-4998-b0c5-30e887803cef tempest-ServerActionsV293TestJSON-390462293 tempest-ServerActionsV293TestJSON-390462293-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 678.255764] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb5badd8-d0c4-4998-b0c5-30e887803cef tempest-ServerActionsV293TestJSON-390462293 tempest-ServerActionsV293TestJSON-390462293-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 678.266374] nova-conductor[53002]: DEBUG nova.quota [None req-eb5badd8-d0c4-4998-b0c5-30e887803cef tempest-ServerActionsV293TestJSON-390462293 tempest-ServerActionsV293TestJSON-390462293-project-member] Getting quotas for project 98e1239fb2b7473dae9b8500dbf977cd. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 678.268668] nova-conductor[53002]: DEBUG nova.quota [None req-eb5badd8-d0c4-4998-b0c5-30e887803cef tempest-ServerActionsV293TestJSON-390462293 tempest-ServerActionsV293TestJSON-390462293-project-member] Getting quotas for user 59668aced4eb47fabea86a0f75ee452f and project 98e1239fb2b7473dae9b8500dbf977cd. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 678.275833] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-eb5badd8-d0c4-4998-b0c5-30e887803cef tempest-ServerActionsV293TestJSON-390462293 tempest-ServerActionsV293TestJSON-390462293-project-member] [instance: c1b6b578-1bed-4e6c-8e7a-34c2e469cd80] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53002) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 678.276373] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb5badd8-d0c4-4998-b0c5-30e887803cef tempest-ServerActionsV293TestJSON-390462293 tempest-ServerActionsV293TestJSON-390462293-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 678.278529] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb5badd8-d0c4-4998-b0c5-30e887803cef tempest-ServerActionsV293TestJSON-390462293 tempest-ServerActionsV293TestJSON-390462293-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 678.278529] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb5badd8-d0c4-4998-b0c5-30e887803cef tempest-ServerActionsV293TestJSON-390462293 tempest-ServerActionsV293TestJSON-390462293-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 678.287567] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-eb5badd8-d0c4-4998-b0c5-30e887803cef tempest-ServerActionsV293TestJSON-390462293 tempest-ServerActionsV293TestJSON-390462293-project-member] [instance: c1b6b578-1bed-4e6c-8e7a-34c2e469cd80] block_device_mapping [BlockDeviceMapping(attachment_id=661f60c5-24bb-47b9-87c0-14e65749d137,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1f0c0e45-c1ef-463a-95dc-478596f5dea4',volume_size=1,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 678.293013] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb5badd8-d0c4-4998-b0c5-30e887803cef tempest-ServerActionsV293TestJSON-390462293 tempest-ServerActionsV293TestJSON-390462293-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 678.293013] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb5badd8-d0c4-4998-b0c5-30e887803cef tempest-ServerActionsV293TestJSON-390462293 tempest-ServerActionsV293TestJSON-390462293-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 678.293013] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb5badd8-d0c4-4998-b0c5-30e887803cef tempest-ServerActionsV293TestJSON-390462293 tempest-ServerActionsV293TestJSON-390462293-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 678.334227] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb5badd8-d0c4-4998-b0c5-30e887803cef tempest-ServerActionsV293TestJSON-390462293 tempest-ServerActionsV293TestJSON-390462293-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 678.334531] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb5badd8-d0c4-4998-b0c5-30e887803cef tempest-ServerActionsV293TestJSON-390462293 tempest-ServerActionsV293TestJSON-390462293-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 678.334630] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-eb5badd8-d0c4-4998-b0c5-30e887803cef tempest-ServerActionsV293TestJSON-390462293 tempest-ServerActionsV293TestJSON-390462293-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 680.417514] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-87481eb0-9c3c-4944-8961-f008b897cc07 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Took 0.17 seconds to select destinations for 1 instance(s). {{(pid=53001) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 680.435547] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-87481eb0-9c3c-4944-8961-f008b897cc07 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 680.435654] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-87481eb0-9c3c-4944-8961-f008b897cc07 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 680.435857] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-87481eb0-9c3c-4944-8961-f008b897cc07 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 680.472710] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-87481eb0-9c3c-4944-8961-f008b897cc07 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 680.472939] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-87481eb0-9c3c-4944-8961-f008b897cc07 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 680.473135] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-87481eb0-9c3c-4944-8961-f008b897cc07 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 680.473697] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-87481eb0-9c3c-4944-8961-f008b897cc07 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 680.473802] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-87481eb0-9c3c-4944-8961-f008b897cc07 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 680.473970] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-87481eb0-9c3c-4944-8961-f008b897cc07 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 680.483207] nova-conductor[53001]: DEBUG nova.quota [None req-87481eb0-9c3c-4944-8961-f008b897cc07 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Getting quotas for project 4ff13b85e9c649c4911ee029ff0304f4. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 680.485629] nova-conductor[53001]: DEBUG nova.quota [None req-87481eb0-9c3c-4944-8961-f008b897cc07 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Getting quotas for user 00dcf60eaad04b91b049aeb30a4f75fc and project 4ff13b85e9c649c4911ee029ff0304f4. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 680.492726] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-87481eb0-9c3c-4944-8961-f008b897cc07 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] [instance: fd3e6440-74fc-4425-9b7e-571245ddc379] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53001) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 680.493384] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-87481eb0-9c3c-4944-8961-f008b897cc07 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 680.493526] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-87481eb0-9c3c-4944-8961-f008b897cc07 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 680.493721] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-87481eb0-9c3c-4944-8961-f008b897cc07 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 680.501388] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-87481eb0-9c3c-4944-8961-f008b897cc07 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] [instance: fd3e6440-74fc-4425-9b7e-571245ddc379] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 680.502077] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-87481eb0-9c3c-4944-8961-f008b897cc07 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 680.502292] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-87481eb0-9c3c-4944-8961-f008b897cc07 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 680.502465] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-87481eb0-9c3c-4944-8961-f008b897cc07 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 680.522333] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-87481eb0-9c3c-4944-8961-f008b897cc07 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 680.522597] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-87481eb0-9c3c-4944-8961-f008b897cc07 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 680.522774] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-87481eb0-9c3c-4944-8961-f008b897cc07 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 681.235607] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Took 0.24 seconds to select destinations for 2 instance(s). {{(pid=53002) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 681.248167] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 681.248810] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 681.249037] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 681.280270] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 681.280827] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 681.281094] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 681.339613] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 681.339953] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 681.340106] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 681.340553] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 681.340859] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 681.341075] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 681.351090] nova-conductor[53002]: DEBUG nova.quota [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Getting quotas for project e712a58321b3496d851d463771623d15. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 681.353811] nova-conductor[53002]: DEBUG nova.quota [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Getting quotas for user c8a348958df440918e0f0fa5e923f9ea and project e712a58321b3496d851d463771623d15. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 681.361144] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] [instance: fbf4b0bc-d87a-4063-87ef-e44f72ecbf5c] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53002) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 681.361698] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 681.363257] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 681.363639] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 681.368226] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] [instance: fbf4b0bc-d87a-4063-87ef-e44f72ecbf5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 681.368951] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 681.369184] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 681.369355] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 681.402917] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 681.403248] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 681.403419] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 681.414540] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] [instance: 81c71aa0-9c68-407a-9bef-708c2cb70b12] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53002) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 681.415050] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 681.415294] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 681.415478] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 681.425782] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] [instance: 81c71aa0-9c68-407a-9bef-708c2cb70b12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 681.426714] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 681.426882] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 681.427074] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 681.447324] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 681.447324] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 681.447479] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 690.387190] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-46fa9596-66bc-4024-b931-31353f9cf956 tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Took 0.14 seconds to select destinations for 1 instance(s). {{(pid=53001) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 690.399952] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-46fa9596-66bc-4024-b931-31353f9cf956 tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 690.400255] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-46fa9596-66bc-4024-b931-31353f9cf956 tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 690.400463] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-46fa9596-66bc-4024-b931-31353f9cf956 tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 690.429341] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-46fa9596-66bc-4024-b931-31353f9cf956 tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 690.429619] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-46fa9596-66bc-4024-b931-31353f9cf956 tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 690.429899] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-46fa9596-66bc-4024-b931-31353f9cf956 tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 690.430242] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-46fa9596-66bc-4024-b931-31353f9cf956 tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 690.430460] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-46fa9596-66bc-4024-b931-31353f9cf956 tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 690.432592] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-46fa9596-66bc-4024-b931-31353f9cf956 tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 690.439632] nova-conductor[53001]: DEBUG nova.quota [None req-46fa9596-66bc-4024-b931-31353f9cf956 tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Getting quotas for project 2a15b42c0a1f4593baf0a8ebdebad01a. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 690.442949] nova-conductor[53001]: DEBUG nova.quota [None req-46fa9596-66bc-4024-b931-31353f9cf956 tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Getting quotas for user 0306ea5ad655409aa0cc29dd85769010 and project 2a15b42c0a1f4593baf0a8ebdebad01a. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 690.458726] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-46fa9596-66bc-4024-b931-31353f9cf956 tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] [instance: bdae41ee-e9c3-4272-9623-ca88464ec45a] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53001) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 690.459205] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-46fa9596-66bc-4024-b931-31353f9cf956 tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 690.459423] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-46fa9596-66bc-4024-b931-31353f9cf956 tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 690.459596] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-46fa9596-66bc-4024-b931-31353f9cf956 tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 690.464786] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-46fa9596-66bc-4024-b931-31353f9cf956 tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] [instance: bdae41ee-e9c3-4272-9623-ca88464ec45a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 690.465539] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-46fa9596-66bc-4024-b931-31353f9cf956 tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 690.465745] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-46fa9596-66bc-4024-b931-31353f9cf956 tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 690.465917] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-46fa9596-66bc-4024-b931-31353f9cf956 tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 690.484761] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-46fa9596-66bc-4024-b931-31353f9cf956 tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 690.485047] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-46fa9596-66bc-4024-b931-31353f9cf956 tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 690.485231] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-46fa9596-66bc-4024-b931-31353f9cf956 tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 691.301657] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-cf73e27a-dcd0-427f-b470-9f587fb5df7d tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Took 0.13 seconds to select destinations for 1 instance(s). {{(pid=53002) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 691.313034] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-cf73e27a-dcd0-427f-b470-9f587fb5df7d tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 691.313282] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-cf73e27a-dcd0-427f-b470-9f587fb5df7d tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 691.313463] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-cf73e27a-dcd0-427f-b470-9f587fb5df7d tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 691.338224] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-cf73e27a-dcd0-427f-b470-9f587fb5df7d tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 691.338452] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-cf73e27a-dcd0-427f-b470-9f587fb5df7d tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 691.338626] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-cf73e27a-dcd0-427f-b470-9f587fb5df7d tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 691.338986] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-cf73e27a-dcd0-427f-b470-9f587fb5df7d tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 691.339186] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-cf73e27a-dcd0-427f-b470-9f587fb5df7d tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 691.339361] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-cf73e27a-dcd0-427f-b470-9f587fb5df7d tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 691.349559] nova-conductor[53002]: DEBUG nova.quota [None req-cf73e27a-dcd0-427f-b470-9f587fb5df7d tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Getting quotas for project 2a15b42c0a1f4593baf0a8ebdebad01a. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 691.351990] nova-conductor[53002]: DEBUG nova.quota [None req-cf73e27a-dcd0-427f-b470-9f587fb5df7d tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Getting quotas for user 0306ea5ad655409aa0cc29dd85769010 and project 2a15b42c0a1f4593baf0a8ebdebad01a. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 691.358987] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-cf73e27a-dcd0-427f-b470-9f587fb5df7d tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] [instance: 3a0515f1-e61a-48d4-980d-49c7189dca2d] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53002) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 691.359175] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-cf73e27a-dcd0-427f-b470-9f587fb5df7d tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 691.359417] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-cf73e27a-dcd0-427f-b470-9f587fb5df7d tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 691.359611] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-cf73e27a-dcd0-427f-b470-9f587fb5df7d tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 691.362780] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-cf73e27a-dcd0-427f-b470-9f587fb5df7d tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] [instance: 3a0515f1-e61a-48d4-980d-49c7189dca2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 691.363466] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-cf73e27a-dcd0-427f-b470-9f587fb5df7d tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 691.363957] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-cf73e27a-dcd0-427f-b470-9f587fb5df7d tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 691.364161] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-cf73e27a-dcd0-427f-b470-9f587fb5df7d tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 691.379936] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-cf73e27a-dcd0-427f-b470-9f587fb5df7d tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 691.380238] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-cf73e27a-dcd0-427f-b470-9f587fb5df7d tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 691.380452] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-cf73e27a-dcd0-427f-b470-9f587fb5df7d tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 713.691026] nova-conductor[53002]: ERROR nova.scheduler.utils [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] [instance: b974272a-5c32-4ed2-99db-1b1ac744d08c] Error from last host: cpu-1 (node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28): ['Traceback (most recent call last):\n', ' File "/opt/stack/nova/nova/compute/manager.py", line 2611, in _build_and_run_instance\n self.driver.spawn(context, instance, image_meta,\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/driver.py", line 529, in spawn\n self._vmops.spawn(context, instance, image_meta, injected_files,\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 786, in spawn\n self._fetch_image_if_missing(context, vi)\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 639, in _fetch_image_if_missing\n image_cache(vi, tmp_image_ds_loc)\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 537, in _cache_sparse_image\n vm_util.copy_virtual_disk(\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vm_util.py", line 1423, in copy_virtual_disk\n session._wait_for_task(vmdk_copy_task)\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/session.py", line 157, in _wait_for_task\n return self.wait_for_task(task_ref)\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_vmware/api.py", line 398, in wait_for_task\n return evt.wait()\n', ' File "/usr/local/lib/python3.10/dist-packages/eventlet/event.py", line 125, in wait\n result = hub.switch()\n', ' File "/usr/local/lib/python3.10/dist-packages/eventlet/hubs/hub.py", line 313, in switch\n return self.greenlet.switch()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_vmware/common/loopingcall.py", line 75, in _inner\n self.f(*self.args, **self.kw)\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_vmware/api.py", line 448, in _poll_task\n raise exceptions.translate_fault(task_info.error)\n', "oslo_vmware.exceptions.VimFaultException: A specified parameter was not correct: fileType\nFaults: ['InvalidArgument']\n", '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', ' File "/opt/stack/nova/nova/compute/manager.py", line 2426, in _do_build_and_run_instance\n self._build_and_run_instance(context, instance, image,\n', ' File "/opt/stack/nova/nova/compute/manager.py", line 2718, in _build_and_run_instance\n raise exception.RescheduledException(\n', "nova.exception.RescheduledException: Build of instance b974272a-5c32-4ed2-99db-1b1ac744d08c was re-scheduled: A specified parameter was not correct: fileType\nFaults: ['InvalidArgument']\n"] [ 713.691026] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] Rescheduling: True {{(pid=53002) build_instances /opt/stack/nova/nova/conductor/manager.py:695}} [ 713.691026] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] Failed to compute_task_build_instances: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance b974272a-5c32-4ed2-99db-1b1ac744d08c.: nova.exception.MaxRetriesExceeded: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance b974272a-5c32-4ed2-99db-1b1ac744d08c. [ 713.691026] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] [instance: b974272a-5c32-4ed2-99db-1b1ac744d08c] Setting instance to ERROR state.: nova.exception.MaxRetriesExceeded: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance b974272a-5c32-4ed2-99db-1b1ac744d08c. [ 713.719643] nova-conductor[53002]: DEBUG nova.network.neutron [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] [instance: b974272a-5c32-4ed2-99db-1b1ac744d08c] deallocate_for_instance() {{(pid=53002) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1803}} [ 713.734899] nova-conductor[53002]: DEBUG nova.network.neutron [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] [instance: b974272a-5c32-4ed2-99db-1b1ac744d08c] Instance cache missing network info. {{(pid=53002) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3323}} [ 713.738151] nova-conductor[53002]: DEBUG nova.network.neutron [None req-252c52dd-2b0e-4ee7-8e94-1b981f114895 tempest-ServerExternalEventsTest-1040538488 tempest-ServerExternalEventsTest-1040538488-project-member] [instance: b974272a-5c32-4ed2-99db-1b1ac744d08c] Updating instance_info_cache with network_info: [] {{(pid=53002) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} [ 719.190222] nova-conductor[53002]: ERROR nova.scheduler.utils [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] [instance: 8f10776c-4124-48fb-9135-d674986d4ad3] Error from last host: cpu-1 (node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28): ['Traceback (most recent call last):\n', ' File "/opt/stack/nova/nova/compute/manager.py", line 2611, in _build_and_run_instance\n self.driver.spawn(context, instance, image_meta,\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/driver.py", line 529, in spawn\n self._vmops.spawn(context, instance, image_meta, injected_files,\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 786, in spawn\n self._fetch_image_if_missing(context, vi)\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 639, in _fetch_image_if_missing\n image_cache(vi, tmp_image_ds_loc)\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 537, in _cache_sparse_image\n vm_util.copy_virtual_disk(\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vm_util.py", line 1423, in copy_virtual_disk\n session._wait_for_task(vmdk_copy_task)\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/session.py", line 157, in _wait_for_task\n return self.wait_for_task(task_ref)\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_vmware/api.py", line 398, in wait_for_task\n return evt.wait()\n', ' File "/usr/local/lib/python3.10/dist-packages/eventlet/event.py", line 125, in wait\n result = hub.switch()\n', ' File "/usr/local/lib/python3.10/dist-packages/eventlet/hubs/hub.py", line 313, in switch\n return self.greenlet.switch()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_vmware/common/loopingcall.py", line 75, in _inner\n self.f(*self.args, **self.kw)\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_vmware/api.py", line 448, in _poll_task\n raise exceptions.translate_fault(task_info.error)\n', "oslo_vmware.exceptions.VimFaultException: A specified parameter was not correct: fileType\nFaults: ['InvalidArgument']\n", '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', ' File "/opt/stack/nova/nova/compute/manager.py", line 2426, in _do_build_and_run_instance\n self._build_and_run_instance(context, instance, image,\n', ' File "/opt/stack/nova/nova/compute/manager.py", line 2718, in _build_and_run_instance\n raise exception.RescheduledException(\n', "nova.exception.RescheduledException: Build of instance 8f10776c-4124-48fb-9135-d674986d4ad3 was re-scheduled: A specified parameter was not correct: fileType\nFaults: ['InvalidArgument']\n"] [ 719.190801] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Rescheduling: True {{(pid=53002) build_instances /opt/stack/nova/nova/conductor/manager.py:695}} [ 719.191052] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Failed to compute_task_build_instances: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 8f10776c-4124-48fb-9135-d674986d4ad3.: nova.exception.MaxRetriesExceeded: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 8f10776c-4124-48fb-9135-d674986d4ad3. [ 719.191274] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] [instance: 8f10776c-4124-48fb-9135-d674986d4ad3] Setting instance to ERROR state.: nova.exception.MaxRetriesExceeded: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 8f10776c-4124-48fb-9135-d674986d4ad3. [ 719.221587] nova-conductor[53002]: DEBUG nova.network.neutron [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] [instance: 8f10776c-4124-48fb-9135-d674986d4ad3] deallocate_for_instance() {{(pid=53002) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1803}} [ 719.248266] nova-conductor[53002]: DEBUG nova.network.neutron [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] [instance: 8f10776c-4124-48fb-9135-d674986d4ad3] Instance cache missing network info. {{(pid=53002) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3323}} [ 719.252027] nova-conductor[53002]: DEBUG nova.network.neutron [None req-67513f80-bc5a-4a37-99dc-57f59becc98d tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] [instance: 8f10776c-4124-48fb-9135-d674986d4ad3] Updating instance_info_cache with network_info: [] {{(pid=53002) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager [None req-feae9f06-5ac2-4be4-aa23-18f8705c29d9 tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 724.374200] nova-conductor[53001]: Traceback (most recent call last): [ 724.374200] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 724.374200] nova-conductor[53001]: return func(*args, **kwargs) [ 724.374200] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 724.374200] nova-conductor[53001]: selections = self._select_destinations( [ 724.374200] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 724.374200] nova-conductor[53001]: selections = self._schedule( [ 724.374200] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 724.374200] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 724.374200] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 724.374200] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 724.374200] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager [ 724.374200] nova-conductor[53001]: ERROR nova.conductor.manager [ 724.382736] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-feae9f06-5ac2-4be4-aa23-18f8705c29d9 tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 724.382982] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-feae9f06-5ac2-4be4-aa23-18f8705c29d9 tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 724.383176] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-feae9f06-5ac2-4be4-aa23-18f8705c29d9 tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 724.442205] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-feae9f06-5ac2-4be4-aa23-18f8705c29d9 tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] [instance: 8d901b68-8c47-4cf1-8d84-d04e8306e2ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 724.444044] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-feae9f06-5ac2-4be4-aa23-18f8705c29d9 tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 724.444044] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-feae9f06-5ac2-4be4-aa23-18f8705c29d9 tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 724.444044] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-feae9f06-5ac2-4be4-aa23-18f8705c29d9 tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 724.448671] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-feae9f06-5ac2-4be4-aa23-18f8705c29d9 tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 724.448671] nova-conductor[53001]: Traceback (most recent call last): [ 724.448671] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 724.448671] nova-conductor[53001]: return func(*args, **kwargs) [ 724.448671] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 724.448671] nova-conductor[53001]: selections = self._select_destinations( [ 724.448671] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 724.448671] nova-conductor[53001]: selections = self._schedule( [ 724.448671] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 724.448671] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 724.448671] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 724.448671] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 724.448671] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 724.448671] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 724.449377] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-feae9f06-5ac2-4be4-aa23-18f8705c29d9 tempest-AttachVolumeShelveTestJSON-723093209 tempest-AttachVolumeShelveTestJSON-723093209-project-member] [instance: 8d901b68-8c47-4cf1-8d84-d04e8306e2ef] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager [None req-fc89dba3-e124-4336-8822-d0a88372c427 tempest-ImagesOneServerTestJSON-1469373596 tempest-ImagesOneServerTestJSON-1469373596-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 726.881973] nova-conductor[53002]: Traceback (most recent call last): [ 726.881973] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 726.881973] nova-conductor[53002]: return func(*args, **kwargs) [ 726.881973] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 726.881973] nova-conductor[53002]: selections = self._select_destinations( [ 726.881973] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 726.881973] nova-conductor[53002]: selections = self._schedule( [ 726.881973] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 726.881973] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 726.881973] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 726.881973] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 726.881973] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager [ 726.881973] nova-conductor[53002]: ERROR nova.conductor.manager [ 726.888860] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-fc89dba3-e124-4336-8822-d0a88372c427 tempest-ImagesOneServerTestJSON-1469373596 tempest-ImagesOneServerTestJSON-1469373596-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 726.889099] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-fc89dba3-e124-4336-8822-d0a88372c427 tempest-ImagesOneServerTestJSON-1469373596 tempest-ImagesOneServerTestJSON-1469373596-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 726.889275] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-fc89dba3-e124-4336-8822-d0a88372c427 tempest-ImagesOneServerTestJSON-1469373596 tempest-ImagesOneServerTestJSON-1469373596-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 726.938029] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-fc89dba3-e124-4336-8822-d0a88372c427 tempest-ImagesOneServerTestJSON-1469373596 tempest-ImagesOneServerTestJSON-1469373596-project-member] [instance: 1691a074-19be-4d27-861e-b24799b50ba6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 726.938789] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-fc89dba3-e124-4336-8822-d0a88372c427 tempest-ImagesOneServerTestJSON-1469373596 tempest-ImagesOneServerTestJSON-1469373596-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 726.939024] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-fc89dba3-e124-4336-8822-d0a88372c427 tempest-ImagesOneServerTestJSON-1469373596 tempest-ImagesOneServerTestJSON-1469373596-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 726.939181] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-fc89dba3-e124-4336-8822-d0a88372c427 tempest-ImagesOneServerTestJSON-1469373596 tempest-ImagesOneServerTestJSON-1469373596-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 726.942072] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-fc89dba3-e124-4336-8822-d0a88372c427 tempest-ImagesOneServerTestJSON-1469373596 tempest-ImagesOneServerTestJSON-1469373596-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 726.942072] nova-conductor[53002]: Traceback (most recent call last): [ 726.942072] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 726.942072] nova-conductor[53002]: return func(*args, **kwargs) [ 726.942072] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 726.942072] nova-conductor[53002]: selections = self._select_destinations( [ 726.942072] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 726.942072] nova-conductor[53002]: selections = self._schedule( [ 726.942072] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 726.942072] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 726.942072] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 726.942072] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 726.942072] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 726.942072] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 726.942680] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-fc89dba3-e124-4336-8822-d0a88372c427 tempest-ImagesOneServerTestJSON-1469373596 tempest-ImagesOneServerTestJSON-1469373596-project-member] [instance: 1691a074-19be-4d27-861e-b24799b50ba6] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager [None req-2a7d982f-456d-496c-bfcc-8c4355be85d3 tempest-ServersTestBootFromVolume-1288516819 tempest-ServersTestBootFromVolume-1288516819-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 754.020806] nova-conductor[53002]: Traceback (most recent call last): [ 754.020806] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 754.020806] nova-conductor[53002]: return func(*args, **kwargs) [ 754.020806] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 754.020806] nova-conductor[53002]: selections = self._select_destinations( [ 754.020806] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 754.020806] nova-conductor[53002]: selections = self._schedule( [ 754.020806] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 754.020806] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 754.020806] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 754.020806] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 754.020806] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager [ 754.020806] nova-conductor[53002]: ERROR nova.conductor.manager [ 754.029106] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-2a7d982f-456d-496c-bfcc-8c4355be85d3 tempest-ServersTestBootFromVolume-1288516819 tempest-ServersTestBootFromVolume-1288516819-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 754.029461] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-2a7d982f-456d-496c-bfcc-8c4355be85d3 tempest-ServersTestBootFromVolume-1288516819 tempest-ServersTestBootFromVolume-1288516819-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 754.029733] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-2a7d982f-456d-496c-bfcc-8c4355be85d3 tempest-ServersTestBootFromVolume-1288516819 tempest-ServersTestBootFromVolume-1288516819-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 754.075255] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-2a7d982f-456d-496c-bfcc-8c4355be85d3 tempest-ServersTestBootFromVolume-1288516819 tempest-ServersTestBootFromVolume-1288516819-project-member] [instance: 623ac3d3-e72c-4499-a4a1-1d18757eee52] block_device_mapping [BlockDeviceMapping(attachment_id=c694e613-dd94-44a0-a30d-a2aa4f442f5e,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a176bf39-2e73-40b7-9177-0aeb6053ad0e',volume_size=1,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 754.076181] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-2a7d982f-456d-496c-bfcc-8c4355be85d3 tempest-ServersTestBootFromVolume-1288516819 tempest-ServersTestBootFromVolume-1288516819-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 754.076553] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-2a7d982f-456d-496c-bfcc-8c4355be85d3 tempest-ServersTestBootFromVolume-1288516819 tempest-ServersTestBootFromVolume-1288516819-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 754.077581] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-2a7d982f-456d-496c-bfcc-8c4355be85d3 tempest-ServersTestBootFromVolume-1288516819 tempest-ServersTestBootFromVolume-1288516819-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 754.085919] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-2a7d982f-456d-496c-bfcc-8c4355be85d3 tempest-ServersTestBootFromVolume-1288516819 tempest-ServersTestBootFromVolume-1288516819-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 754.085919] nova-conductor[53002]: Traceback (most recent call last): [ 754.085919] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 754.085919] nova-conductor[53002]: return func(*args, **kwargs) [ 754.085919] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 754.085919] nova-conductor[53002]: selections = self._select_destinations( [ 754.085919] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 754.085919] nova-conductor[53002]: selections = self._schedule( [ 754.085919] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 754.085919] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 754.085919] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 754.085919] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 754.085919] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 754.085919] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 754.086783] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-2a7d982f-456d-496c-bfcc-8c4355be85d3 tempest-ServersTestBootFromVolume-1288516819 tempest-ServersTestBootFromVolume-1288516819-project-member] [instance: 623ac3d3-e72c-4499-a4a1-1d18757eee52] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 755.702735] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-9bf5722c-1236-4b33-8006-6c056614262c tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Took 0.12 seconds to select destinations for 1 instance(s). {{(pid=53001) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 755.719015] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-9bf5722c-1236-4b33-8006-6c056614262c tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 755.719349] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-9bf5722c-1236-4b33-8006-6c056614262c tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 755.719576] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-9bf5722c-1236-4b33-8006-6c056614262c tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 755.751138] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-9bf5722c-1236-4b33-8006-6c056614262c tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 755.751526] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-9bf5722c-1236-4b33-8006-6c056614262c tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 755.751780] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-9bf5722c-1236-4b33-8006-6c056614262c tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 755.752231] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-9bf5722c-1236-4b33-8006-6c056614262c tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 755.752489] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-9bf5722c-1236-4b33-8006-6c056614262c tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 755.752727] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-9bf5722c-1236-4b33-8006-6c056614262c tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 755.761912] nova-conductor[53001]: DEBUG nova.quota [None req-9bf5722c-1236-4b33-8006-6c056614262c tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Getting quotas for project 8a91009401dd409ca662573757dfaf88. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 755.764526] nova-conductor[53001]: DEBUG nova.quota [None req-9bf5722c-1236-4b33-8006-6c056614262c tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Getting quotas for user de88047992ae4098acd029bd2bd55b1f and project 8a91009401dd409ca662573757dfaf88. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 755.770717] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-9bf5722c-1236-4b33-8006-6c056614262c tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] [instance: 30cf201d-7a1c-479c-9040-fba38726d9ab] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53001) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 755.771273] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-9bf5722c-1236-4b33-8006-6c056614262c tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 755.771532] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-9bf5722c-1236-4b33-8006-6c056614262c tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 755.771749] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-9bf5722c-1236-4b33-8006-6c056614262c tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 755.776759] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-9bf5722c-1236-4b33-8006-6c056614262c tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] [instance: 30cf201d-7a1c-479c-9040-fba38726d9ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 755.777485] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-9bf5722c-1236-4b33-8006-6c056614262c tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 755.777696] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-9bf5722c-1236-4b33-8006-6c056614262c tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 755.777868] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-9bf5722c-1236-4b33-8006-6c056614262c tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 755.791661] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-9bf5722c-1236-4b33-8006-6c056614262c tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 755.791951] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-9bf5722c-1236-4b33-8006-6c056614262c tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 755.792193] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-9bf5722c-1236-4b33-8006-6c056614262c tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 763.159759] nova-conductor[53002]: DEBUG nova.db.main.api [None req-943340a9-8bfb-497d-894d-b41b7d054998 tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Created instance_extra for 3a7076f4-fc00-4f82-804b-4dac0de9ab3d {{(pid=53002) instance_extra_update_by_uuid /opt/stack/nova/nova/db/main/api.py:2551}} [ 810.799249] nova-conductor[53001]: ERROR nova.scheduler.utils [None req-e2551337-bf2e-49c0-bb2a-4d923160bab9 tempest-ServersAdmin275Test-568000092 tempest-ServersAdmin275Test-568000092-project-member] [instance: b2a1b0c6-91cd-437d-b5bf-ca618b008c23] Error from last host: cpu-1 (node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28): ['Traceback (most recent call last):\n', ' File "/opt/stack/nova/nova/compute/manager.py", line 2611, in _build_and_run_instance\n self.driver.spawn(context, instance, image_meta,\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/driver.py", line 529, in spawn\n self._vmops.spawn(context, instance, image_meta, injected_files,\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 786, in spawn\n self._fetch_image_if_missing(context, vi)\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 639, in _fetch_image_if_missing\n image_cache(vi, tmp_image_ds_loc)\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 537, in _cache_sparse_image\n vm_util.copy_virtual_disk(\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vm_util.py", line 1423, in copy_virtual_disk\n session._wait_for_task(vmdk_copy_task)\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/session.py", line 157, in _wait_for_task\n return self.wait_for_task(task_ref)\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_vmware/api.py", line 398, in wait_for_task\n return evt.wait()\n', ' File "/usr/local/lib/python3.10/dist-packages/eventlet/event.py", line 125, in wait\n result = hub.switch()\n', ' File "/usr/local/lib/python3.10/dist-packages/eventlet/hubs/hub.py", line 313, in switch\n return self.greenlet.switch()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_vmware/common/loopingcall.py", line 75, in _inner\n self.f(*self.args, **self.kw)\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_vmware/api.py", line 448, in _poll_task\n raise exceptions.translate_fault(task_info.error)\n', "oslo_vmware.exceptions.VimFaultException: A specified parameter was not correct: fileType\nFaults: ['InvalidArgument']\n", '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', ' File "/opt/stack/nova/nova/compute/manager.py", line 2426, in _do_build_and_run_instance\n self._build_and_run_instance(context, instance, image,\n', ' File "/opt/stack/nova/nova/compute/manager.py", line 2718, in _build_and_run_instance\n raise exception.RescheduledException(\n', "nova.exception.RescheduledException: Build of instance b2a1b0c6-91cd-437d-b5bf-ca618b008c23 was re-scheduled: A specified parameter was not correct: fileType\nFaults: ['InvalidArgument']\n"] [ 810.799950] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-e2551337-bf2e-49c0-bb2a-4d923160bab9 tempest-ServersAdmin275Test-568000092 tempest-ServersAdmin275Test-568000092-project-member] Rescheduling: True {{(pid=53001) build_instances /opt/stack/nova/nova/conductor/manager.py:695}} [ 810.800219] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-e2551337-bf2e-49c0-bb2a-4d923160bab9 tempest-ServersAdmin275Test-568000092 tempest-ServersAdmin275Test-568000092-project-member] Failed to compute_task_build_instances: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance b2a1b0c6-91cd-437d-b5bf-ca618b008c23.: nova.exception.MaxRetriesExceeded: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance b2a1b0c6-91cd-437d-b5bf-ca618b008c23. [ 810.800537] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-e2551337-bf2e-49c0-bb2a-4d923160bab9 tempest-ServersAdmin275Test-568000092 tempest-ServersAdmin275Test-568000092-project-member] [instance: b2a1b0c6-91cd-437d-b5bf-ca618b008c23] Setting instance to ERROR state.: nova.exception.MaxRetriesExceeded: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance b2a1b0c6-91cd-437d-b5bf-ca618b008c23. [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager [None req-262bb50a-d658-40a0-b6dd-701a52826ae4 tempest-ServersTestFqdnHostnames-948951085 tempest-ServersTestFqdnHostnames-948951085-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 818.824216] nova-conductor[53002]: Traceback (most recent call last): [ 818.824216] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 818.824216] nova-conductor[53002]: return func(*args, **kwargs) [ 818.824216] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 818.824216] nova-conductor[53002]: selections = self._select_destinations( [ 818.824216] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 818.824216] nova-conductor[53002]: selections = self._schedule( [ 818.824216] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 818.824216] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 818.824216] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 818.824216] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 818.824216] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager [ 818.824216] nova-conductor[53002]: ERROR nova.conductor.manager [ 818.831192] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-262bb50a-d658-40a0-b6dd-701a52826ae4 tempest-ServersTestFqdnHostnames-948951085 tempest-ServersTestFqdnHostnames-948951085-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 818.831522] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-262bb50a-d658-40a0-b6dd-701a52826ae4 tempest-ServersTestFqdnHostnames-948951085 tempest-ServersTestFqdnHostnames-948951085-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 818.831736] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-262bb50a-d658-40a0-b6dd-701a52826ae4 tempest-ServersTestFqdnHostnames-948951085 tempest-ServersTestFqdnHostnames-948951085-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 818.878021] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-262bb50a-d658-40a0-b6dd-701a52826ae4 tempest-ServersTestFqdnHostnames-948951085 tempest-ServersTestFqdnHostnames-948951085-project-member] [instance: 1b843e1e-d840-490d-a8f4-226682231001] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 818.878743] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-262bb50a-d658-40a0-b6dd-701a52826ae4 tempest-ServersTestFqdnHostnames-948951085 tempest-ServersTestFqdnHostnames-948951085-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 818.879026] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-262bb50a-d658-40a0-b6dd-701a52826ae4 tempest-ServersTestFqdnHostnames-948951085 tempest-ServersTestFqdnHostnames-948951085-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 818.879211] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-262bb50a-d658-40a0-b6dd-701a52826ae4 tempest-ServersTestFqdnHostnames-948951085 tempest-ServersTestFqdnHostnames-948951085-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 818.884342] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-262bb50a-d658-40a0-b6dd-701a52826ae4 tempest-ServersTestFqdnHostnames-948951085 tempest-ServersTestFqdnHostnames-948951085-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 818.884342] nova-conductor[53002]: Traceback (most recent call last): [ 818.884342] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 818.884342] nova-conductor[53002]: return func(*args, **kwargs) [ 818.884342] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 818.884342] nova-conductor[53002]: selections = self._select_destinations( [ 818.884342] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 818.884342] nova-conductor[53002]: selections = self._schedule( [ 818.884342] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 818.884342] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 818.884342] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 818.884342] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 818.884342] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 818.884342] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 818.885159] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-262bb50a-d658-40a0-b6dd-701a52826ae4 tempest-ServersTestFqdnHostnames-948951085 tempest-ServersTestFqdnHostnames-948951085-project-member] [instance: 1b843e1e-d840-490d-a8f4-226682231001] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager [None req-851309e0-fddd-4a46-a228-e3fc86643652 tempest-ServerActionsTestOtherA-484765884 tempest-ServerActionsTestOtherA-484765884-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 827.881098] nova-conductor[53001]: Traceback (most recent call last): [ 827.881098] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 827.881098] nova-conductor[53001]: return func(*args, **kwargs) [ 827.881098] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 827.881098] nova-conductor[53001]: selections = self._select_destinations( [ 827.881098] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 827.881098] nova-conductor[53001]: selections = self._schedule( [ 827.881098] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 827.881098] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 827.881098] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 827.881098] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 827.881098] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager [ 827.881098] nova-conductor[53001]: ERROR nova.conductor.manager [ 827.888125] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-851309e0-fddd-4a46-a228-e3fc86643652 tempest-ServerActionsTestOtherA-484765884 tempest-ServerActionsTestOtherA-484765884-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 827.888369] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-851309e0-fddd-4a46-a228-e3fc86643652 tempest-ServerActionsTestOtherA-484765884 tempest-ServerActionsTestOtherA-484765884-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 827.888542] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-851309e0-fddd-4a46-a228-e3fc86643652 tempest-ServerActionsTestOtherA-484765884 tempest-ServerActionsTestOtherA-484765884-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 827.930960] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-851309e0-fddd-4a46-a228-e3fc86643652 tempest-ServerActionsTestOtherA-484765884 tempest-ServerActionsTestOtherA-484765884-project-member] [instance: 348ff6f5-ff7d-47ca-ab2a-415a5fe33ef3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 827.931642] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-851309e0-fddd-4a46-a228-e3fc86643652 tempest-ServerActionsTestOtherA-484765884 tempest-ServerActionsTestOtherA-484765884-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 827.931964] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-851309e0-fddd-4a46-a228-e3fc86643652 tempest-ServerActionsTestOtherA-484765884 tempest-ServerActionsTestOtherA-484765884-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 827.932072] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-851309e0-fddd-4a46-a228-e3fc86643652 tempest-ServerActionsTestOtherA-484765884 tempest-ServerActionsTestOtherA-484765884-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 827.935767] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-851309e0-fddd-4a46-a228-e3fc86643652 tempest-ServerActionsTestOtherA-484765884 tempest-ServerActionsTestOtherA-484765884-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 827.935767] nova-conductor[53001]: Traceback (most recent call last): [ 827.935767] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 827.935767] nova-conductor[53001]: return func(*args, **kwargs) [ 827.935767] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 827.935767] nova-conductor[53001]: selections = self._select_destinations( [ 827.935767] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 827.935767] nova-conductor[53001]: selections = self._schedule( [ 827.935767] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 827.935767] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 827.935767] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 827.935767] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 827.935767] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 827.935767] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 827.936664] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-851309e0-fddd-4a46-a228-e3fc86643652 tempest-ServerActionsTestOtherA-484765884 tempest-ServerActionsTestOtherA-484765884-project-member] [instance: 348ff6f5-ff7d-47ca-ab2a-415a5fe33ef3] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager [None req-effe7109-7e32-44d5-b195-8ed060257f12 tempest-ServerRescueTestJSONUnderV235-1592611651 tempest-ServerRescueTestJSONUnderV235-1592611651-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 844.687111] nova-conductor[53002]: Traceback (most recent call last): [ 844.687111] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 844.687111] nova-conductor[53002]: return func(*args, **kwargs) [ 844.687111] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 844.687111] nova-conductor[53002]: selections = self._select_destinations( [ 844.687111] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 844.687111] nova-conductor[53002]: selections = self._schedule( [ 844.687111] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 844.687111] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 844.687111] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 844.687111] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 844.687111] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager [ 844.687111] nova-conductor[53002]: ERROR nova.conductor.manager [ 844.701108] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-effe7109-7e32-44d5-b195-8ed060257f12 tempest-ServerRescueTestJSONUnderV235-1592611651 tempest-ServerRescueTestJSONUnderV235-1592611651-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 844.701354] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-effe7109-7e32-44d5-b195-8ed060257f12 tempest-ServerRescueTestJSONUnderV235-1592611651 tempest-ServerRescueTestJSONUnderV235-1592611651-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 844.701520] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-effe7109-7e32-44d5-b195-8ed060257f12 tempest-ServerRescueTestJSONUnderV235-1592611651 tempest-ServerRescueTestJSONUnderV235-1592611651-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 844.744182] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-effe7109-7e32-44d5-b195-8ed060257f12 tempest-ServerRescueTestJSONUnderV235-1592611651 tempest-ServerRescueTestJSONUnderV235-1592611651-project-member] [instance: 1abd5cc2-0f08-4772-ba4d-b05301990a01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 844.744937] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-effe7109-7e32-44d5-b195-8ed060257f12 tempest-ServerRescueTestJSONUnderV235-1592611651 tempest-ServerRescueTestJSONUnderV235-1592611651-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 844.745168] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-effe7109-7e32-44d5-b195-8ed060257f12 tempest-ServerRescueTestJSONUnderV235-1592611651 tempest-ServerRescueTestJSONUnderV235-1592611651-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 844.745342] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-effe7109-7e32-44d5-b195-8ed060257f12 tempest-ServerRescueTestJSONUnderV235-1592611651 tempest-ServerRescueTestJSONUnderV235-1592611651-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 844.748131] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-effe7109-7e32-44d5-b195-8ed060257f12 tempest-ServerRescueTestJSONUnderV235-1592611651 tempest-ServerRescueTestJSONUnderV235-1592611651-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 844.748131] nova-conductor[53002]: Traceback (most recent call last): [ 844.748131] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 844.748131] nova-conductor[53002]: return func(*args, **kwargs) [ 844.748131] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 844.748131] nova-conductor[53002]: selections = self._select_destinations( [ 844.748131] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 844.748131] nova-conductor[53002]: selections = self._schedule( [ 844.748131] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 844.748131] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 844.748131] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 844.748131] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 844.748131] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 844.748131] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 844.748656] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-effe7109-7e32-44d5-b195-8ed060257f12 tempest-ServerRescueTestJSONUnderV235-1592611651 tempest-ServerRescueTestJSONUnderV235-1592611651-project-member] [instance: 1abd5cc2-0f08-4772-ba4d-b05301990a01] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager [None req-763f2cef-c2f0-472d-8f5d-fc2c922044ed tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 847.437167] nova-conductor[53001]: Traceback (most recent call last): [ 847.437167] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 847.437167] nova-conductor[53001]: return func(*args, **kwargs) [ 847.437167] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 847.437167] nova-conductor[53001]: selections = self._select_destinations( [ 847.437167] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 847.437167] nova-conductor[53001]: selections = self._schedule( [ 847.437167] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 847.437167] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 847.437167] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 847.437167] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 847.437167] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager [ 847.437167] nova-conductor[53001]: ERROR nova.conductor.manager [ 847.444533] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-763f2cef-c2f0-472d-8f5d-fc2c922044ed tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 847.444533] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-763f2cef-c2f0-472d-8f5d-fc2c922044ed tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 847.444669] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-763f2cef-c2f0-472d-8f5d-fc2c922044ed tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 847.506160] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-763f2cef-c2f0-472d-8f5d-fc2c922044ed tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] [instance: 8e79d864-a6d3-47f9-a9bd-3ec691a3eaa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 847.506947] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-763f2cef-c2f0-472d-8f5d-fc2c922044ed tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 847.507210] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-763f2cef-c2f0-472d-8f5d-fc2c922044ed tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 847.507383] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-763f2cef-c2f0-472d-8f5d-fc2c922044ed tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 847.511231] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-763f2cef-c2f0-472d-8f5d-fc2c922044ed tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 847.511231] nova-conductor[53001]: Traceback (most recent call last): [ 847.511231] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 847.511231] nova-conductor[53001]: return func(*args, **kwargs) [ 847.511231] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 847.511231] nova-conductor[53001]: selections = self._select_destinations( [ 847.511231] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 847.511231] nova-conductor[53001]: selections = self._schedule( [ 847.511231] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 847.511231] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 847.511231] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 847.511231] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 847.511231] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 847.511231] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 847.511768] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-763f2cef-c2f0-472d-8f5d-fc2c922044ed tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] [instance: 8e79d864-a6d3-47f9-a9bd-3ec691a3eaa4] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager [None req-0f546e7e-50e7-4764-bb06-5d8509bd684e tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 856.158366] nova-conductor[53002]: Traceback (most recent call last): [ 856.158366] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 856.158366] nova-conductor[53002]: return func(*args, **kwargs) [ 856.158366] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 856.158366] nova-conductor[53002]: selections = self._select_destinations( [ 856.158366] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 856.158366] nova-conductor[53002]: selections = self._schedule( [ 856.158366] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 856.158366] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 856.158366] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 856.158366] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 856.158366] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager [ 856.158366] nova-conductor[53002]: ERROR nova.conductor.manager [ 856.175897] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-0f546e7e-50e7-4764-bb06-5d8509bd684e tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 856.176103] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-0f546e7e-50e7-4764-bb06-5d8509bd684e tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 856.176332] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-0f546e7e-50e7-4764-bb06-5d8509bd684e tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 856.241742] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-0f546e7e-50e7-4764-bb06-5d8509bd684e tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] [instance: a961f273-c700-4566-82b1-104f88277778] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 856.243485] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-0f546e7e-50e7-4764-bb06-5d8509bd684e tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 856.243485] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-0f546e7e-50e7-4764-bb06-5d8509bd684e tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 856.243616] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-0f546e7e-50e7-4764-bb06-5d8509bd684e tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 856.249110] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-0f546e7e-50e7-4764-bb06-5d8509bd684e tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 856.249110] nova-conductor[53002]: Traceback (most recent call last): [ 856.249110] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 856.249110] nova-conductor[53002]: return func(*args, **kwargs) [ 856.249110] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 856.249110] nova-conductor[53002]: selections = self._select_destinations( [ 856.249110] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 856.249110] nova-conductor[53002]: selections = self._schedule( [ 856.249110] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 856.249110] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 856.249110] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 856.249110] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 856.249110] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 856.249110] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 856.250668] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-0f546e7e-50e7-4764-bb06-5d8509bd684e tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] [instance: a961f273-c700-4566-82b1-104f88277778] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager [None req-4fc10820-38d4-4a6c-b994-938a98d948a2 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 858.739991] nova-conductor[53002]: Traceback (most recent call last): [ 858.739991] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 858.739991] nova-conductor[53002]: return func(*args, **kwargs) [ 858.739991] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 858.739991] nova-conductor[53002]: selections = self._select_destinations( [ 858.739991] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 858.739991] nova-conductor[53002]: selections = self._schedule( [ 858.739991] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 858.739991] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 858.739991] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 858.739991] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 858.739991] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager [ 858.739991] nova-conductor[53002]: ERROR nova.conductor.manager [ 858.747672] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-4fc10820-38d4-4a6c-b994-938a98d948a2 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 858.747926] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-4fc10820-38d4-4a6c-b994-938a98d948a2 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 858.748100] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-4fc10820-38d4-4a6c-b994-938a98d948a2 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 858.806583] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-4fc10820-38d4-4a6c-b994-938a98d948a2 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] [instance: 332af2c6-b1f1-4574-85eb-9ecf1e0112f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 858.807296] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-4fc10820-38d4-4a6c-b994-938a98d948a2 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 858.807511] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-4fc10820-38d4-4a6c-b994-938a98d948a2 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 858.808513] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-4fc10820-38d4-4a6c-b994-938a98d948a2 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 858.813110] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-4fc10820-38d4-4a6c-b994-938a98d948a2 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 858.813110] nova-conductor[53002]: Traceback (most recent call last): [ 858.813110] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 858.813110] nova-conductor[53002]: return func(*args, **kwargs) [ 858.813110] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 858.813110] nova-conductor[53002]: selections = self._select_destinations( [ 858.813110] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 858.813110] nova-conductor[53002]: selections = self._schedule( [ 858.813110] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 858.813110] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 858.813110] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 858.813110] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 858.813110] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 858.813110] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 858.813895] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-4fc10820-38d4-4a6c-b994-938a98d948a2 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] [instance: 332af2c6-b1f1-4574-85eb-9ecf1e0112f9] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager [None req-f5619106-81e1-43a2-8c0e-3abde491a339 tempest-AttachInterfacesUnderV243Test-2102890562 tempest-AttachInterfacesUnderV243Test-2102890562-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 859.135179] nova-conductor[53001]: Traceback (most recent call last): [ 859.135179] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 859.135179] nova-conductor[53001]: return func(*args, **kwargs) [ 859.135179] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 859.135179] nova-conductor[53001]: selections = self._select_destinations( [ 859.135179] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 859.135179] nova-conductor[53001]: selections = self._schedule( [ 859.135179] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 859.135179] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 859.135179] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 859.135179] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 859.135179] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager [ 859.135179] nova-conductor[53001]: ERROR nova.conductor.manager [ 859.145591] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f5619106-81e1-43a2-8c0e-3abde491a339 tempest-AttachInterfacesUnderV243Test-2102890562 tempest-AttachInterfacesUnderV243Test-2102890562-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 859.146230] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f5619106-81e1-43a2-8c0e-3abde491a339 tempest-AttachInterfacesUnderV243Test-2102890562 tempest-AttachInterfacesUnderV243Test-2102890562-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 859.146635] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f5619106-81e1-43a2-8c0e-3abde491a339 tempest-AttachInterfacesUnderV243Test-2102890562 tempest-AttachInterfacesUnderV243Test-2102890562-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 859.231151] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-f5619106-81e1-43a2-8c0e-3abde491a339 tempest-AttachInterfacesUnderV243Test-2102890562 tempest-AttachInterfacesUnderV243Test-2102890562-project-member] [instance: b2493c5f-1b04-4c1d-ac7c-3ec95e8484fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 859.231857] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f5619106-81e1-43a2-8c0e-3abde491a339 tempest-AttachInterfacesUnderV243Test-2102890562 tempest-AttachInterfacesUnderV243Test-2102890562-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 859.232057] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f5619106-81e1-43a2-8c0e-3abde491a339 tempest-AttachInterfacesUnderV243Test-2102890562 tempest-AttachInterfacesUnderV243Test-2102890562-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 859.232244] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f5619106-81e1-43a2-8c0e-3abde491a339 tempest-AttachInterfacesUnderV243Test-2102890562 tempest-AttachInterfacesUnderV243Test-2102890562-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 859.241946] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-f5619106-81e1-43a2-8c0e-3abde491a339 tempest-AttachInterfacesUnderV243Test-2102890562 tempest-AttachInterfacesUnderV243Test-2102890562-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 859.241946] nova-conductor[53001]: Traceback (most recent call last): [ 859.241946] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 859.241946] nova-conductor[53001]: return func(*args, **kwargs) [ 859.241946] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 859.241946] nova-conductor[53001]: selections = self._select_destinations( [ 859.241946] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 859.241946] nova-conductor[53001]: selections = self._schedule( [ 859.241946] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 859.241946] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 859.241946] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 859.241946] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 859.241946] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 859.241946] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 859.241946] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-f5619106-81e1-43a2-8c0e-3abde491a339 tempest-AttachInterfacesUnderV243Test-2102890562 tempest-AttachInterfacesUnderV243Test-2102890562-project-member] [instance: b2493c5f-1b04-4c1d-ac7c-3ec95e8484fd] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 859.334013] nova-conductor[53002]: ERROR nova.scheduler.utils [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] [instance: 9a14b9d0-876b-45c6-825e-103caac6bef9] Error from last host: cpu-1 (node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28): ['Traceback (most recent call last):\n', ' File "/opt/stack/nova/nova/compute/manager.py", line 2611, in _build_and_run_instance\n self.driver.spawn(context, instance, image_meta,\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/driver.py", line 529, in spawn\n self._vmops.spawn(context, instance, image_meta, injected_files,\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 786, in spawn\n self._fetch_image_if_missing(context, vi)\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 639, in _fetch_image_if_missing\n image_cache(vi, tmp_image_ds_loc)\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 537, in _cache_sparse_image\n vm_util.copy_virtual_disk(\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vm_util.py", line 1423, in copy_virtual_disk\n session._wait_for_task(vmdk_copy_task)\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/session.py", line 157, in _wait_for_task\n return self.wait_for_task(task_ref)\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_vmware/api.py", line 398, in wait_for_task\n return evt.wait()\n', ' File "/usr/local/lib/python3.10/dist-packages/eventlet/event.py", line 125, in wait\n result = hub.switch()\n', ' File "/usr/local/lib/python3.10/dist-packages/eventlet/hubs/hub.py", line 313, in switch\n return self.greenlet.switch()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_vmware/common/loopingcall.py", line 75, in _inner\n self.f(*self.args, **self.kw)\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_vmware/api.py", line 448, in _poll_task\n raise exceptions.translate_fault(task_info.error)\n', "oslo_vmware.exceptions.VimFaultException: A specified parameter was not correct: fileType\nFaults: ['InvalidArgument']\n", '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', ' File "/opt/stack/nova/nova/compute/manager.py", line 2426, in _do_build_and_run_instance\n self._build_and_run_instance(context, instance, image,\n', ' File "/opt/stack/nova/nova/compute/manager.py", line 2718, in _build_and_run_instance\n raise exception.RescheduledException(\n', "nova.exception.RescheduledException: Build of instance 9a14b9d0-876b-45c6-825e-103caac6bef9 was re-scheduled: A specified parameter was not correct: fileType\nFaults: ['InvalidArgument']\n"] [ 859.334615] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Rescheduling: True {{(pid=53002) build_instances /opt/stack/nova/nova/conductor/manager.py:695}} [ 859.334856] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Failed to compute_task_build_instances: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 9a14b9d0-876b-45c6-825e-103caac6bef9.: nova.exception.MaxRetriesExceeded: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 9a14b9d0-876b-45c6-825e-103caac6bef9. [ 859.335139] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] [instance: 9a14b9d0-876b-45c6-825e-103caac6bef9] Setting instance to ERROR state.: nova.exception.MaxRetriesExceeded: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 9a14b9d0-876b-45c6-825e-103caac6bef9. [ 859.362121] nova-conductor[53002]: DEBUG nova.network.neutron [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] [instance: 9a14b9d0-876b-45c6-825e-103caac6bef9] deallocate_for_instance() {{(pid=53002) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1803}} [ 859.390610] nova-conductor[53002]: DEBUG nova.network.neutron [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] [instance: 9a14b9d0-876b-45c6-825e-103caac6bef9] Instance cache missing network info. {{(pid=53002) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3323}} [ 859.396294] nova-conductor[53002]: DEBUG nova.network.neutron [None req-24d3a34a-be7e-4c97-8991-2487c305083e tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] [instance: 9a14b9d0-876b-45c6-825e-103caac6bef9] Updating instance_info_cache with network_info: [] {{(pid=53002) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager [None req-3910b4b1-9e10-4058-989d-26abe630e2ef tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 860.749013] nova-conductor[53001]: Traceback (most recent call last): [ 860.749013] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 860.749013] nova-conductor[53001]: return func(*args, **kwargs) [ 860.749013] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 860.749013] nova-conductor[53001]: selections = self._select_destinations( [ 860.749013] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 860.749013] nova-conductor[53001]: selections = self._schedule( [ 860.749013] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 860.749013] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 860.749013] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 860.749013] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 860.749013] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager [ 860.749013] nova-conductor[53001]: ERROR nova.conductor.manager [ 860.756037] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-3910b4b1-9e10-4058-989d-26abe630e2ef tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 860.756273] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-3910b4b1-9e10-4058-989d-26abe630e2ef tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 860.756468] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-3910b4b1-9e10-4058-989d-26abe630e2ef tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 860.806865] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-3910b4b1-9e10-4058-989d-26abe630e2ef tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] [instance: 793f820e-8ea5-46ef-93b2-276a239ad62b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 860.808154] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-3910b4b1-9e10-4058-989d-26abe630e2ef tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 860.808154] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-3910b4b1-9e10-4058-989d-26abe630e2ef tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 860.808154] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-3910b4b1-9e10-4058-989d-26abe630e2ef tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 860.810951] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-3910b4b1-9e10-4058-989d-26abe630e2ef tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 860.810951] nova-conductor[53001]: Traceback (most recent call last): [ 860.810951] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 860.810951] nova-conductor[53001]: return func(*args, **kwargs) [ 860.810951] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 860.810951] nova-conductor[53001]: selections = self._select_destinations( [ 860.810951] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 860.810951] nova-conductor[53001]: selections = self._schedule( [ 860.810951] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 860.810951] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 860.810951] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 860.810951] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 860.810951] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 860.810951] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 860.811486] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-3910b4b1-9e10-4058-989d-26abe630e2ef tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] [instance: 793f820e-8ea5-46ef-93b2-276a239ad62b] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager [None req-c2e26974-7950-4a54-8381-6366504b1ce2 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 861.926720] nova-conductor[53002]: Traceback (most recent call last): [ 861.926720] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 861.926720] nova-conductor[53002]: return func(*args, **kwargs) [ 861.926720] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 861.926720] nova-conductor[53002]: selections = self._select_destinations( [ 861.926720] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 861.926720] nova-conductor[53002]: selections = self._schedule( [ 861.926720] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 861.926720] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 861.926720] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 861.926720] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 861.926720] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager [ 861.926720] nova-conductor[53002]: ERROR nova.conductor.manager [ 861.936537] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c2e26974-7950-4a54-8381-6366504b1ce2 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 861.936782] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c2e26974-7950-4a54-8381-6366504b1ce2 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 861.936989] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c2e26974-7950-4a54-8381-6366504b1ce2 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 861.990344] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-c2e26974-7950-4a54-8381-6366504b1ce2 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] [instance: 909ac62e-89a8-4dcf-b623-e0d250ed6d2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 861.991182] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c2e26974-7950-4a54-8381-6366504b1ce2 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 861.991408] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c2e26974-7950-4a54-8381-6366504b1ce2 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 861.991585] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c2e26974-7950-4a54-8381-6366504b1ce2 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 861.995556] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-c2e26974-7950-4a54-8381-6366504b1ce2 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 861.995556] nova-conductor[53002]: Traceback (most recent call last): [ 861.995556] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 861.995556] nova-conductor[53002]: return func(*args, **kwargs) [ 861.995556] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 861.995556] nova-conductor[53002]: selections = self._select_destinations( [ 861.995556] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 861.995556] nova-conductor[53002]: selections = self._schedule( [ 861.995556] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 861.995556] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 861.995556] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 861.995556] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 861.995556] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 861.995556] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 861.996423] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-c2e26974-7950-4a54-8381-6366504b1ce2 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] [instance: 909ac62e-89a8-4dcf-b623-e0d250ed6d2e] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 862.303376] nova-conductor[53002]: DEBUG nova.db.main.api [None req-348fc44a-8435-47bd-86c7-d1c4bfe70069 tempest-ServerGroupTestJSON-1519550876 tempest-ServerGroupTestJSON-1519550876-project-member] Created instance_extra for 67cbaf5c-e743-4e07-8f74-c51e4f57914d {{(pid=53002) instance_extra_update_by_uuid /opt/stack/nova/nova/db/main/api.py:2551}} [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager [None req-c64ceae8-38c6-4ab5-99e7-9069950a9da1 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 864.486206] nova-conductor[53001]: Traceback (most recent call last): [ 864.486206] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 864.486206] nova-conductor[53001]: return func(*args, **kwargs) [ 864.486206] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 864.486206] nova-conductor[53001]: selections = self._select_destinations( [ 864.486206] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 864.486206] nova-conductor[53001]: selections = self._schedule( [ 864.486206] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 864.486206] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 864.486206] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 864.486206] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 864.486206] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager [ 864.486206] nova-conductor[53001]: ERROR nova.conductor.manager [ 864.494445] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-c64ceae8-38c6-4ab5-99e7-9069950a9da1 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 864.494727] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-c64ceae8-38c6-4ab5-99e7-9069950a9da1 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 864.494948] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-c64ceae8-38c6-4ab5-99e7-9069950a9da1 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 864.551961] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-c64ceae8-38c6-4ab5-99e7-9069950a9da1 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] [instance: a59cb04a-93c6-4fd6-bf70-14977ae59f77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 864.552796] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-c64ceae8-38c6-4ab5-99e7-9069950a9da1 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 864.552950] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-c64ceae8-38c6-4ab5-99e7-9069950a9da1 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 864.553160] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-c64ceae8-38c6-4ab5-99e7-9069950a9da1 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 864.556906] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-c64ceae8-38c6-4ab5-99e7-9069950a9da1 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 864.556906] nova-conductor[53001]: Traceback (most recent call last): [ 864.556906] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 864.556906] nova-conductor[53001]: return func(*args, **kwargs) [ 864.556906] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 864.556906] nova-conductor[53001]: selections = self._select_destinations( [ 864.556906] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 864.556906] nova-conductor[53001]: selections = self._schedule( [ 864.556906] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 864.556906] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 864.556906] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 864.556906] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 864.556906] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 864.556906] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 864.557664] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-c64ceae8-38c6-4ab5-99e7-9069950a9da1 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] [instance: a59cb04a-93c6-4fd6-bf70-14977ae59f77] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager [None req-7da43ce9-98f0-4a18-a3f1-e6f9b12622bf tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 865.055639] nova-conductor[53002]: Traceback (most recent call last): [ 865.055639] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 865.055639] nova-conductor[53002]: return func(*args, **kwargs) [ 865.055639] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 865.055639] nova-conductor[53002]: selections = self._select_destinations( [ 865.055639] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 865.055639] nova-conductor[53002]: selections = self._schedule( [ 865.055639] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 865.055639] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 865.055639] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 865.055639] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 865.055639] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager [ 865.055639] nova-conductor[53002]: ERROR nova.conductor.manager [ 865.067569] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-7da43ce9-98f0-4a18-a3f1-e6f9b12622bf tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 865.067701] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-7da43ce9-98f0-4a18-a3f1-e6f9b12622bf tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 865.067860] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-7da43ce9-98f0-4a18-a3f1-e6f9b12622bf tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 865.117548] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-7da43ce9-98f0-4a18-a3f1-e6f9b12622bf tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] [instance: 0c2a8610-580a-4f18-9836-2db395b241aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 865.119297] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-7da43ce9-98f0-4a18-a3f1-e6f9b12622bf tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 865.119452] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-7da43ce9-98f0-4a18-a3f1-e6f9b12622bf tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 865.119604] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-7da43ce9-98f0-4a18-a3f1-e6f9b12622bf tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 865.128663] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-7da43ce9-98f0-4a18-a3f1-e6f9b12622bf tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 865.128663] nova-conductor[53002]: Traceback (most recent call last): [ 865.128663] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 865.128663] nova-conductor[53002]: return func(*args, **kwargs) [ 865.128663] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 865.128663] nova-conductor[53002]: selections = self._select_destinations( [ 865.128663] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 865.128663] nova-conductor[53002]: selections = self._schedule( [ 865.128663] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 865.128663] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 865.128663] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 865.128663] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 865.128663] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 865.128663] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 865.128663] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-7da43ce9-98f0-4a18-a3f1-e6f9b12622bf tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] [instance: 0c2a8610-580a-4f18-9836-2db395b241aa] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager [None req-8993c96d-711d-4781-b953-b575bb91306a tempest-ServerShowV254Test-963040893 tempest-ServerShowV254Test-963040893-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 865.974622] nova-conductor[53001]: Traceback (most recent call last): [ 865.974622] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 865.974622] nova-conductor[53001]: return func(*args, **kwargs) [ 865.974622] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 865.974622] nova-conductor[53001]: selections = self._select_destinations( [ 865.974622] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 865.974622] nova-conductor[53001]: selections = self._schedule( [ 865.974622] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 865.974622] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 865.974622] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 865.974622] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 865.974622] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager [ 865.974622] nova-conductor[53001]: ERROR nova.conductor.manager [ 865.990801] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-8993c96d-711d-4781-b953-b575bb91306a tempest-ServerShowV254Test-963040893 tempest-ServerShowV254Test-963040893-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 865.991645] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-8993c96d-711d-4781-b953-b575bb91306a tempest-ServerShowV254Test-963040893 tempest-ServerShowV254Test-963040893-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 865.991645] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-8993c96d-711d-4781-b953-b575bb91306a tempest-ServerShowV254Test-963040893 tempest-ServerShowV254Test-963040893-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 866.047464] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-8993c96d-711d-4781-b953-b575bb91306a tempest-ServerShowV254Test-963040893 tempest-ServerShowV254Test-963040893-project-member] [instance: 7f7c458c-4041-46f2-9cd6-789d998d6a50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 866.047911] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-8993c96d-711d-4781-b953-b575bb91306a tempest-ServerShowV254Test-963040893 tempest-ServerShowV254Test-963040893-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 866.049188] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-8993c96d-711d-4781-b953-b575bb91306a tempest-ServerShowV254Test-963040893 tempest-ServerShowV254Test-963040893-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 866.049423] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-8993c96d-711d-4781-b953-b575bb91306a tempest-ServerShowV254Test-963040893 tempest-ServerShowV254Test-963040893-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 866.053957] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-8993c96d-711d-4781-b953-b575bb91306a tempest-ServerShowV254Test-963040893 tempest-ServerShowV254Test-963040893-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 866.053957] nova-conductor[53001]: Traceback (most recent call last): [ 866.053957] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 866.053957] nova-conductor[53001]: return func(*args, **kwargs) [ 866.053957] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 866.053957] nova-conductor[53001]: selections = self._select_destinations( [ 866.053957] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 866.053957] nova-conductor[53001]: selections = self._schedule( [ 866.053957] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 866.053957] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 866.053957] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 866.053957] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 866.053957] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 866.053957] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 866.054512] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-8993c96d-711d-4781-b953-b575bb91306a tempest-ServerShowV254Test-963040893 tempest-ServerShowV254Test-963040893-project-member] [instance: 7f7c458c-4041-46f2-9cd6-789d998d6a50] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager [None req-60f12b4a-3071-4476-ae81-b014ad8dad2f tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 867.938313] nova-conductor[53001]: Traceback (most recent call last): [ 867.938313] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 867.938313] nova-conductor[53001]: return func(*args, **kwargs) [ 867.938313] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 867.938313] nova-conductor[53001]: selections = self._select_destinations( [ 867.938313] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 867.938313] nova-conductor[53001]: selections = self._schedule( [ 867.938313] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 867.938313] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 867.938313] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 867.938313] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 867.938313] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager [ 867.938313] nova-conductor[53001]: ERROR nova.conductor.manager [ 867.945216] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-60f12b4a-3071-4476-ae81-b014ad8dad2f tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 867.945454] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-60f12b4a-3071-4476-ae81-b014ad8dad2f tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 867.945628] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-60f12b4a-3071-4476-ae81-b014ad8dad2f tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 867.984117] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-60f12b4a-3071-4476-ae81-b014ad8dad2f tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] [instance: 7c58ad43-11a4-4331-8e48-1d23402cdcbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 867.984888] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-60f12b4a-3071-4476-ae81-b014ad8dad2f tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 867.985119] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-60f12b4a-3071-4476-ae81-b014ad8dad2f tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 867.985299] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-60f12b4a-3071-4476-ae81-b014ad8dad2f tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 867.988380] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-60f12b4a-3071-4476-ae81-b014ad8dad2f tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 867.988380] nova-conductor[53001]: Traceback (most recent call last): [ 867.988380] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 867.988380] nova-conductor[53001]: return func(*args, **kwargs) [ 867.988380] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 867.988380] nova-conductor[53001]: selections = self._select_destinations( [ 867.988380] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 867.988380] nova-conductor[53001]: selections = self._schedule( [ 867.988380] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 867.988380] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 867.988380] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 867.988380] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 867.988380] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 867.988380] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 867.988875] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-60f12b4a-3071-4476-ae81-b014ad8dad2f tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] [instance: 7c58ad43-11a4-4331-8e48-1d23402cdcbb] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager [None req-9b2b048e-16f0-4f4a-bcb4-e64ea08b3dbb tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 868.458661] nova-conductor[53002]: Traceback (most recent call last): [ 868.458661] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 868.458661] nova-conductor[53002]: return func(*args, **kwargs) [ 868.458661] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 868.458661] nova-conductor[53002]: selections = self._select_destinations( [ 868.458661] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 868.458661] nova-conductor[53002]: selections = self._schedule( [ 868.458661] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 868.458661] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 868.458661] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 868.458661] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 868.458661] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager [ 868.458661] nova-conductor[53002]: ERROR nova.conductor.manager [ 868.465040] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-9b2b048e-16f0-4f4a-bcb4-e64ea08b3dbb tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 868.466403] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-9b2b048e-16f0-4f4a-bcb4-e64ea08b3dbb tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 868.466403] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-9b2b048e-16f0-4f4a-bcb4-e64ea08b3dbb tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 868.547870] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-9b2b048e-16f0-4f4a-bcb4-e64ea08b3dbb tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] [instance: 48fd03a4-45c9-4ceb-be5f-44aebe51e5f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 868.548438] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-9b2b048e-16f0-4f4a-bcb4-e64ea08b3dbb tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 868.548699] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-9b2b048e-16f0-4f4a-bcb4-e64ea08b3dbb tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 868.549877] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-9b2b048e-16f0-4f4a-bcb4-e64ea08b3dbb tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 868.555383] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-9b2b048e-16f0-4f4a-bcb4-e64ea08b3dbb tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 868.555383] nova-conductor[53002]: Traceback (most recent call last): [ 868.555383] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 868.555383] nova-conductor[53002]: return func(*args, **kwargs) [ 868.555383] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 868.555383] nova-conductor[53002]: selections = self._select_destinations( [ 868.555383] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 868.555383] nova-conductor[53002]: selections = self._schedule( [ 868.555383] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 868.555383] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 868.555383] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 868.555383] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 868.555383] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 868.555383] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 868.555883] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-9b2b048e-16f0-4f4a-bcb4-e64ea08b3dbb tempest-ImagesTestJSON-104737604 tempest-ImagesTestJSON-104737604-project-member] [instance: 48fd03a4-45c9-4ceb-be5f-44aebe51e5f4] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager [None req-59451b04-e3bb-4452-80cc-744bd9d28ae5 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 871.495887] nova-conductor[53002]: Traceback (most recent call last): [ 871.495887] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 871.495887] nova-conductor[53002]: return func(*args, **kwargs) [ 871.495887] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 871.495887] nova-conductor[53002]: selections = self._select_destinations( [ 871.495887] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 871.495887] nova-conductor[53002]: selections = self._schedule( [ 871.495887] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 871.495887] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 871.495887] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 871.495887] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 871.495887] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager [ 871.495887] nova-conductor[53002]: ERROR nova.conductor.manager [ 871.511551] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-59451b04-e3bb-4452-80cc-744bd9d28ae5 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 871.511551] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-59451b04-e3bb-4452-80cc-744bd9d28ae5 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 871.511551] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-59451b04-e3bb-4452-80cc-744bd9d28ae5 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 871.561820] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-59451b04-e3bb-4452-80cc-744bd9d28ae5 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] [instance: 71ddccef-2ba5-476e-a85b-e3e69de7d61d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 871.562619] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-59451b04-e3bb-4452-80cc-744bd9d28ae5 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 871.563496] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-59451b04-e3bb-4452-80cc-744bd9d28ae5 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 871.563496] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-59451b04-e3bb-4452-80cc-744bd9d28ae5 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 871.569475] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-59451b04-e3bb-4452-80cc-744bd9d28ae5 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 871.569475] nova-conductor[53002]: Traceback (most recent call last): [ 871.569475] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 871.569475] nova-conductor[53002]: return func(*args, **kwargs) [ 871.569475] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 871.569475] nova-conductor[53002]: selections = self._select_destinations( [ 871.569475] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 871.569475] nova-conductor[53002]: selections = self._schedule( [ 871.569475] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 871.569475] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 871.569475] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 871.569475] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 871.569475] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 871.569475] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 871.569475] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-59451b04-e3bb-4452-80cc-744bd9d28ae5 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] [instance: 71ddccef-2ba5-476e-a85b-e3e69de7d61d] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager [None req-c45d9227-7126-4043-b888-845aa263ea48 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 873.591345] nova-conductor[53002]: Traceback (most recent call last): [ 873.591345] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 873.591345] nova-conductor[53002]: return func(*args, **kwargs) [ 873.591345] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 873.591345] nova-conductor[53002]: selections = self._select_destinations( [ 873.591345] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 873.591345] nova-conductor[53002]: selections = self._schedule( [ 873.591345] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 873.591345] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 873.591345] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 873.591345] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 873.591345] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager [ 873.591345] nova-conductor[53002]: ERROR nova.conductor.manager [ 873.597838] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c45d9227-7126-4043-b888-845aa263ea48 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 873.598107] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c45d9227-7126-4043-b888-845aa263ea48 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 873.598548] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c45d9227-7126-4043-b888-845aa263ea48 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 873.644502] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-c45d9227-7126-4043-b888-845aa263ea48 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] [instance: 74280902-97e7-45c1-a1c0-726e7c1793a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 873.645228] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c45d9227-7126-4043-b888-845aa263ea48 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 873.645442] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c45d9227-7126-4043-b888-845aa263ea48 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 873.645620] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c45d9227-7126-4043-b888-845aa263ea48 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 873.648771] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-c45d9227-7126-4043-b888-845aa263ea48 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 873.648771] nova-conductor[53002]: Traceback (most recent call last): [ 873.648771] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 873.648771] nova-conductor[53002]: return func(*args, **kwargs) [ 873.648771] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 873.648771] nova-conductor[53002]: selections = self._select_destinations( [ 873.648771] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 873.648771] nova-conductor[53002]: selections = self._schedule( [ 873.648771] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 873.648771] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 873.648771] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 873.648771] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 873.648771] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 873.648771] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 873.649390] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-c45d9227-7126-4043-b888-845aa263ea48 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] [instance: 74280902-97e7-45c1-a1c0-726e7c1793a9] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 875.823558] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-c07ba2b1-1566-4f59-a77f-855deef06699 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Took 0.17 seconds to select destinations for 1 instance(s). {{(pid=53002) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 875.840309] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c07ba2b1-1566-4f59-a77f-855deef06699 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 875.840538] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c07ba2b1-1566-4f59-a77f-855deef06699 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 875.840705] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c07ba2b1-1566-4f59-a77f-855deef06699 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 875.876661] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c07ba2b1-1566-4f59-a77f-855deef06699 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 875.876897] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c07ba2b1-1566-4f59-a77f-855deef06699 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 875.877164] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c07ba2b1-1566-4f59-a77f-855deef06699 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 875.877923] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c07ba2b1-1566-4f59-a77f-855deef06699 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 875.877923] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c07ba2b1-1566-4f59-a77f-855deef06699 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 875.877923] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c07ba2b1-1566-4f59-a77f-855deef06699 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 875.888315] nova-conductor[53002]: DEBUG nova.quota [None req-c07ba2b1-1566-4f59-a77f-855deef06699 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Getting quotas for project e5343838b9d64cf0aeb72c368f89eea7. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 875.891186] nova-conductor[53002]: DEBUG nova.quota [None req-c07ba2b1-1566-4f59-a77f-855deef06699 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Getting quotas for user cac1cb748fa746608741e950ceadb1b8 and project e5343838b9d64cf0aeb72c368f89eea7. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 875.896238] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-c07ba2b1-1566-4f59-a77f-855deef06699 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] [instance: ad98988d-92aa-4ace-8e40-cd316758002e] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53002) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 875.897189] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c07ba2b1-1566-4f59-a77f-855deef06699 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 875.897189] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c07ba2b1-1566-4f59-a77f-855deef06699 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 875.897189] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c07ba2b1-1566-4f59-a77f-855deef06699 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 875.900267] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-c07ba2b1-1566-4f59-a77f-855deef06699 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] [instance: ad98988d-92aa-4ace-8e40-cd316758002e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 875.900886] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c07ba2b1-1566-4f59-a77f-855deef06699 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 875.900886] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c07ba2b1-1566-4f59-a77f-855deef06699 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 875.901058] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c07ba2b1-1566-4f59-a77f-855deef06699 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 875.918347] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c07ba2b1-1566-4f59-a77f-855deef06699 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 875.918576] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c07ba2b1-1566-4f59-a77f-855deef06699 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 875.918746] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-c07ba2b1-1566-4f59-a77f-855deef06699 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 878.263624] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] Took 0.16 seconds to select destinations for 1 instance(s). {{(pid=53001) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 878.281291] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 878.284072] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 878.284072] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 878.317157] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 878.319069] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 878.319069] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 878.319069] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 878.319069] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 878.319069] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 878.327883] nova-conductor[53001]: DEBUG nova.quota [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] Getting quotas for project 3c6e9283a81a4cc197709fd070c13c34. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 878.331299] nova-conductor[53001]: DEBUG nova.quota [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] Getting quotas for user 7d367cd15b484e3bad1edfd948ee2d38 and project 3c6e9283a81a4cc197709fd070c13c34. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 878.337020] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] [instance: 585e3015-faef-40df-b3dd-04d2c8e4dd00] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53001) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 878.339468] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 878.339468] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 878.339468] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 878.341437] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] [instance: 585e3015-faef-40df-b3dd-04d2c8e4dd00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 878.342134] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 878.342339] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 878.342504] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 878.360277] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 878.360523] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 878.360772] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 879.621465] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-6766186b-35b4-4dde-bcd8-61195c9eff1b tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Took 0.14 seconds to select destinations for 1 instance(s). {{(pid=53002) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 879.631738] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-6766186b-35b4-4dde-bcd8-61195c9eff1b tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] [instance: dc642213-69ba-45e0-b172-99639bfcd92f] While scheduling instance, the build request was already deleted. {{(pid=53002) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1706}} [ 879.751513] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-6766186b-35b4-4dde-bcd8-61195c9eff1b tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 879.751703] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-6766186b-35b4-4dde-bcd8-61195c9eff1b tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 879.751929] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-6766186b-35b4-4dde-bcd8-61195c9eff1b tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 879.753935] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-6766186b-35b4-4dde-bcd8-61195c9eff1b tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 879.753935] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-6766186b-35b4-4dde-bcd8-61195c9eff1b tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 879.753935] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-6766186b-35b4-4dde-bcd8-61195c9eff1b tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 879.774358] nova-conductor[53002]: DEBUG nova.quota [None req-6766186b-35b4-4dde-bcd8-61195c9eff1b tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Getting quotas for project 4ff13b85e9c649c4911ee029ff0304f4. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 879.775347] nova-conductor[53002]: DEBUG nova.quota [None req-6766186b-35b4-4dde-bcd8-61195c9eff1b tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Getting quotas for user 00dcf60eaad04b91b049aeb30a4f75fc and project 4ff13b85e9c649c4911ee029ff0304f4. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 881.314470] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Took 0.21 seconds to select destinations for 2 instance(s). {{(pid=53001) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 881.338382] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-26693311-fafe-4637-808f-85f1e9ea6a77 tempest-ImagesOneServerNegativeTestJSON-1667424217 tempest-ImagesOneServerNegativeTestJSON-1667424217-project-member] Took 0.15 seconds to select destinations for 1 instance(s). {{(pid=53002) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 881.342459] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 881.342699] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 881.342872] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 881.359385] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-26693311-fafe-4637-808f-85f1e9ea6a77 tempest-ImagesOneServerNegativeTestJSON-1667424217 tempest-ImagesOneServerNegativeTestJSON-1667424217-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 881.360680] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-26693311-fafe-4637-808f-85f1e9ea6a77 tempest-ImagesOneServerNegativeTestJSON-1667424217 tempest-ImagesOneServerNegativeTestJSON-1667424217-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 881.361198] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-26693311-fafe-4637-808f-85f1e9ea6a77 tempest-ImagesOneServerNegativeTestJSON-1667424217 tempest-ImagesOneServerNegativeTestJSON-1667424217-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 881.379573] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 881.379818] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 881.379979] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 881.405222] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 881.405525] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 881.405652] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 881.406120] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 881.406203] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 881.406364] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 881.407184] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-26693311-fafe-4637-808f-85f1e9ea6a77 tempest-ImagesOneServerNegativeTestJSON-1667424217 tempest-ImagesOneServerNegativeTestJSON-1667424217-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 881.407391] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-26693311-fafe-4637-808f-85f1e9ea6a77 tempest-ImagesOneServerNegativeTestJSON-1667424217 tempest-ImagesOneServerNegativeTestJSON-1667424217-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 881.407570] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-26693311-fafe-4637-808f-85f1e9ea6a77 tempest-ImagesOneServerNegativeTestJSON-1667424217 tempest-ImagesOneServerNegativeTestJSON-1667424217-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 881.407924] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-26693311-fafe-4637-808f-85f1e9ea6a77 tempest-ImagesOneServerNegativeTestJSON-1667424217 tempest-ImagesOneServerNegativeTestJSON-1667424217-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 881.408128] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-26693311-fafe-4637-808f-85f1e9ea6a77 tempest-ImagesOneServerNegativeTestJSON-1667424217 tempest-ImagesOneServerNegativeTestJSON-1667424217-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 881.408297] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-26693311-fafe-4637-808f-85f1e9ea6a77 tempest-ImagesOneServerNegativeTestJSON-1667424217 tempest-ImagesOneServerNegativeTestJSON-1667424217-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 881.415604] nova-conductor[53001]: DEBUG nova.quota [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Getting quotas for project e712a58321b3496d851d463771623d15. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 881.417392] nova-conductor[53002]: DEBUG nova.quota [None req-26693311-fafe-4637-808f-85f1e9ea6a77 tempest-ImagesOneServerNegativeTestJSON-1667424217 tempest-ImagesOneServerNegativeTestJSON-1667424217-project-member] Getting quotas for project b69a6d4834e24a3cbc4019ee66c0d841. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 881.418060] nova-conductor[53001]: DEBUG nova.quota [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Getting quotas for user c8a348958df440918e0f0fa5e923f9ea and project e712a58321b3496d851d463771623d15. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 881.420298] nova-conductor[53002]: DEBUG nova.quota [None req-26693311-fafe-4637-808f-85f1e9ea6a77 tempest-ImagesOneServerNegativeTestJSON-1667424217 tempest-ImagesOneServerNegativeTestJSON-1667424217-project-member] Getting quotas for user d122dc69e91c4228826688c92f76b66d and project b69a6d4834e24a3cbc4019ee66c0d841. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 881.424130] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] [instance: e3fd811a-186d-436f-bdef-a910a3ccd416] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53001) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 881.424639] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 881.424849] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 881.425037] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 881.427778] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-26693311-fafe-4637-808f-85f1e9ea6a77 tempest-ImagesOneServerNegativeTestJSON-1667424217 tempest-ImagesOneServerNegativeTestJSON-1667424217-project-member] [instance: 979c5fe5-051f-4a43-be2f-571aad25a4ae] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53002) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 881.428467] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] [instance: e3fd811a-186d-436f-bdef-a910a3ccd416] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 881.428640] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-26693311-fafe-4637-808f-85f1e9ea6a77 tempest-ImagesOneServerNegativeTestJSON-1667424217 tempest-ImagesOneServerNegativeTestJSON-1667424217-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 881.428862] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-26693311-fafe-4637-808f-85f1e9ea6a77 tempest-ImagesOneServerNegativeTestJSON-1667424217 tempest-ImagesOneServerNegativeTestJSON-1667424217-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 881.429184] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-26693311-fafe-4637-808f-85f1e9ea6a77 tempest-ImagesOneServerNegativeTestJSON-1667424217 tempest-ImagesOneServerNegativeTestJSON-1667424217-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 881.429282] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 881.429420] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 881.429609] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 881.431761] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-26693311-fafe-4637-808f-85f1e9ea6a77 tempest-ImagesOneServerNegativeTestJSON-1667424217 tempest-ImagesOneServerNegativeTestJSON-1667424217-project-member] [instance: 979c5fe5-051f-4a43-be2f-571aad25a4ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 881.432396] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-26693311-fafe-4637-808f-85f1e9ea6a77 tempest-ImagesOneServerNegativeTestJSON-1667424217 tempest-ImagesOneServerNegativeTestJSON-1667424217-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 881.432602] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-26693311-fafe-4637-808f-85f1e9ea6a77 tempest-ImagesOneServerNegativeTestJSON-1667424217 tempest-ImagesOneServerNegativeTestJSON-1667424217-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 881.432940] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-26693311-fafe-4637-808f-85f1e9ea6a77 tempest-ImagesOneServerNegativeTestJSON-1667424217 tempest-ImagesOneServerNegativeTestJSON-1667424217-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 881.444380] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 881.444626] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 881.444818] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 881.445263] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-26693311-fafe-4637-808f-85f1e9ea6a77 tempest-ImagesOneServerNegativeTestJSON-1667424217 tempest-ImagesOneServerNegativeTestJSON-1667424217-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 881.445576] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-26693311-fafe-4637-808f-85f1e9ea6a77 tempest-ImagesOneServerNegativeTestJSON-1667424217 tempest-ImagesOneServerNegativeTestJSON-1667424217-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 881.445664] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-26693311-fafe-4637-808f-85f1e9ea6a77 tempest-ImagesOneServerNegativeTestJSON-1667424217 tempest-ImagesOneServerNegativeTestJSON-1667424217-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 881.450925] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] [instance: 8f447658-c66d-4d94-af30-fd43c83dae0e] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53001) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 881.451416] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 881.451624] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 881.451797] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 881.457774] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] [instance: 8f447658-c66d-4d94-af30-fd43c83dae0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 881.457774] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 881.457774] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 881.457774] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 881.477918] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 881.478506] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 881.478736] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-7667719b-d156-4a33-8877-e4d01d2f86dc tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 881.943217] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-a26ed563-f496-4f2b-9f25-4d1be3d67373 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Took 0.15 seconds to select destinations for 1 instance(s). {{(pid=53001) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 881.957273] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-a26ed563-f496-4f2b-9f25-4d1be3d67373 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 881.957957] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-a26ed563-f496-4f2b-9f25-4d1be3d67373 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 881.958146] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-a26ed563-f496-4f2b-9f25-4d1be3d67373 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 882.001553] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-a26ed563-f496-4f2b-9f25-4d1be3d67373 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 882.001749] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-a26ed563-f496-4f2b-9f25-4d1be3d67373 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 882.004017] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-a26ed563-f496-4f2b-9f25-4d1be3d67373 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 882.004017] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-a26ed563-f496-4f2b-9f25-4d1be3d67373 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 882.004017] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-a26ed563-f496-4f2b-9f25-4d1be3d67373 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 882.004017] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-a26ed563-f496-4f2b-9f25-4d1be3d67373 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 882.012543] nova-conductor[53001]: DEBUG nova.quota [None req-a26ed563-f496-4f2b-9f25-4d1be3d67373 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Getting quotas for project 4ff13b85e9c649c4911ee029ff0304f4. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 882.018775] nova-conductor[53001]: DEBUG nova.quota [None req-a26ed563-f496-4f2b-9f25-4d1be3d67373 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Getting quotas for user 00dcf60eaad04b91b049aeb30a4f75fc and project 4ff13b85e9c649c4911ee029ff0304f4. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 882.028159] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-a26ed563-f496-4f2b-9f25-4d1be3d67373 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] [instance: e6466fbb-a225-4bbd-839b-f8c4b24d9860] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53001) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 882.028159] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-a26ed563-f496-4f2b-9f25-4d1be3d67373 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 882.028307] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-a26ed563-f496-4f2b-9f25-4d1be3d67373 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 882.028478] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-a26ed563-f496-4f2b-9f25-4d1be3d67373 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 882.032551] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-a26ed563-f496-4f2b-9f25-4d1be3d67373 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] [instance: e6466fbb-a225-4bbd-839b-f8c4b24d9860] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 882.033260] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-a26ed563-f496-4f2b-9f25-4d1be3d67373 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 882.034196] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-a26ed563-f496-4f2b-9f25-4d1be3d67373 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 882.034196] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-a26ed563-f496-4f2b-9f25-4d1be3d67373 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 882.047661] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-a26ed563-f496-4f2b-9f25-4d1be3d67373 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 882.047868] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-a26ed563-f496-4f2b-9f25-4d1be3d67373 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 882.048061] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-a26ed563-f496-4f2b-9f25-4d1be3d67373 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 883.969027] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-9103344d-50c2-42d3-af1b-42e70de1a0d4 tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Took 0.14 seconds to select destinations for 1 instance(s). {{(pid=53002) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 883.980494] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-9103344d-50c2-42d3-af1b-42e70de1a0d4 tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 883.980783] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-9103344d-50c2-42d3-af1b-42e70de1a0d4 tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 883.980889] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-9103344d-50c2-42d3-af1b-42e70de1a0d4 tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 884.009786] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-9103344d-50c2-42d3-af1b-42e70de1a0d4 tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 884.010391] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-9103344d-50c2-42d3-af1b-42e70de1a0d4 tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 884.010728] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-9103344d-50c2-42d3-af1b-42e70de1a0d4 tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 884.011240] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-9103344d-50c2-42d3-af1b-42e70de1a0d4 tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 884.011593] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-9103344d-50c2-42d3-af1b-42e70de1a0d4 tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 884.011931] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-9103344d-50c2-42d3-af1b-42e70de1a0d4 tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 884.022186] nova-conductor[53002]: DEBUG nova.quota [None req-9103344d-50c2-42d3-af1b-42e70de1a0d4 tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Getting quotas for project 4c0d2d521309468ba27acf66751f02f7. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 884.024731] nova-conductor[53002]: DEBUG nova.quota [None req-9103344d-50c2-42d3-af1b-42e70de1a0d4 tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Getting quotas for user 1937efa54ca4481f8260913e983bb134 and project 4c0d2d521309468ba27acf66751f02f7. Resources: {'instances', 'ram', 'cores'} {{(pid=53002) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 884.030364] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-9103344d-50c2-42d3-af1b-42e70de1a0d4 tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] [instance: 3d0fbb3e-8b84-4ba9-bb7a-e679b6e2ed04] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53002) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 884.031037] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-9103344d-50c2-42d3-af1b-42e70de1a0d4 tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 884.031406] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-9103344d-50c2-42d3-af1b-42e70de1a0d4 tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 884.031742] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-9103344d-50c2-42d3-af1b-42e70de1a0d4 tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 884.035128] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-9103344d-50c2-42d3-af1b-42e70de1a0d4 tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] [instance: 3d0fbb3e-8b84-4ba9-bb7a-e679b6e2ed04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 884.038010] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-9103344d-50c2-42d3-af1b-42e70de1a0d4 tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 884.038010] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-9103344d-50c2-42d3-af1b-42e70de1a0d4 tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 884.038010] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-9103344d-50c2-42d3-af1b-42e70de1a0d4 tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 884.051039] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-9103344d-50c2-42d3-af1b-42e70de1a0d4 tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 884.051436] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-9103344d-50c2-42d3-af1b-42e70de1a0d4 tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 884.051746] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-9103344d-50c2-42d3-af1b-42e70de1a0d4 tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 884.325530] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-f9eca8e6-2e63-4f31-994e-5c4047c0e98b tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Took 0.12 seconds to select destinations for 1 instance(s). {{(pid=53001) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 884.337433] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f9eca8e6-2e63-4f31-994e-5c4047c0e98b tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 884.337675] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f9eca8e6-2e63-4f31-994e-5c4047c0e98b tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 884.337848] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f9eca8e6-2e63-4f31-994e-5c4047c0e98b tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 884.364211] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f9eca8e6-2e63-4f31-994e-5c4047c0e98b tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 884.364482] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f9eca8e6-2e63-4f31-994e-5c4047c0e98b tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 884.364663] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f9eca8e6-2e63-4f31-994e-5c4047c0e98b tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 884.365027] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f9eca8e6-2e63-4f31-994e-5c4047c0e98b tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 884.365223] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f9eca8e6-2e63-4f31-994e-5c4047c0e98b tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 884.365388] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f9eca8e6-2e63-4f31-994e-5c4047c0e98b tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 884.374522] nova-conductor[53001]: DEBUG nova.quota [None req-f9eca8e6-2e63-4f31-994e-5c4047c0e98b tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Getting quotas for project e843b5ba56114cf99c1ae8c7e8617e73. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 884.377573] nova-conductor[53001]: DEBUG nova.quota [None req-f9eca8e6-2e63-4f31-994e-5c4047c0e98b tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Getting quotas for user 1ef4b39480314d249536efa5b839e1fe and project e843b5ba56114cf99c1ae8c7e8617e73. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 884.383176] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-f9eca8e6-2e63-4f31-994e-5c4047c0e98b tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] [instance: d0d515a4-15ce-4276-b151-34a8a556a1df] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53001) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 884.385235] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f9eca8e6-2e63-4f31-994e-5c4047c0e98b tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 884.385235] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f9eca8e6-2e63-4f31-994e-5c4047c0e98b tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 884.385235] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f9eca8e6-2e63-4f31-994e-5c4047c0e98b tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 884.387581] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-f9eca8e6-2e63-4f31-994e-5c4047c0e98b tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] [instance: d0d515a4-15ce-4276-b151-34a8a556a1df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 884.387747] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f9eca8e6-2e63-4f31-994e-5c4047c0e98b tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 884.387954] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f9eca8e6-2e63-4f31-994e-5c4047c0e98b tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 884.388140] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f9eca8e6-2e63-4f31-994e-5c4047c0e98b tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 884.401327] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f9eca8e6-2e63-4f31-994e-5c4047c0e98b tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 884.402306] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f9eca8e6-2e63-4f31-994e-5c4047c0e98b tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 884.402611] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f9eca8e6-2e63-4f31-994e-5c4047c0e98b tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 908.690416] nova-conductor[53001]: ERROR nova.scheduler.utils [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] [instance: 386edc81-5f27-4e44-af7a-f5e47ded1327] Error from last host: cpu-1 (node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28): ['Traceback (most recent call last):\n', ' File "/opt/stack/nova/nova/compute/manager.py", line 2611, in _build_and_run_instance\n self.driver.spawn(context, instance, image_meta,\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/driver.py", line 529, in spawn\n self._vmops.spawn(context, instance, image_meta, injected_files,\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 786, in spawn\n self._fetch_image_if_missing(context, vi)\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 639, in _fetch_image_if_missing\n image_cache(vi, tmp_image_ds_loc)\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 537, in _cache_sparse_image\n vm_util.copy_virtual_disk(\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vm_util.py", line 1423, in copy_virtual_disk\n session._wait_for_task(vmdk_copy_task)\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/session.py", line 157, in _wait_for_task\n return self.wait_for_task(task_ref)\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_vmware/api.py", line 398, in wait_for_task\n return evt.wait()\n', ' File "/usr/local/lib/python3.10/dist-packages/eventlet/event.py", line 125, in wait\n result = hub.switch()\n', ' File "/usr/local/lib/python3.10/dist-packages/eventlet/hubs/hub.py", line 313, in switch\n return self.greenlet.switch()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_vmware/common/loopingcall.py", line 75, in _inner\n self.f(*self.args, **self.kw)\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_vmware/api.py", line 448, in _poll_task\n raise exceptions.translate_fault(task_info.error)\n', "oslo_vmware.exceptions.VimFaultException: A specified parameter was not correct: fileType\nFaults: ['InvalidArgument']\n", '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', ' File "/opt/stack/nova/nova/compute/manager.py", line 2426, in _do_build_and_run_instance\n self._build_and_run_instance(context, instance, image,\n', ' File "/opt/stack/nova/nova/compute/manager.py", line 2718, in _build_and_run_instance\n raise exception.RescheduledException(\n', "nova.exception.RescheduledException: Build of instance 386edc81-5f27-4e44-af7a-f5e47ded1327 was re-scheduled: A specified parameter was not correct: fileType\nFaults: ['InvalidArgument']\n"] [ 908.691660] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] Rescheduling: True {{(pid=53001) build_instances /opt/stack/nova/nova/conductor/manager.py:695}} [ 908.695887] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] Failed to compute_task_build_instances: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 386edc81-5f27-4e44-af7a-f5e47ded1327.: nova.exception.MaxRetriesExceeded: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 386edc81-5f27-4e44-af7a-f5e47ded1327. [ 908.695887] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] [instance: 386edc81-5f27-4e44-af7a-f5e47ded1327] Setting instance to ERROR state.: nova.exception.MaxRetriesExceeded: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 386edc81-5f27-4e44-af7a-f5e47ded1327. [ 908.722810] nova-conductor[53001]: DEBUG nova.network.neutron [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] [instance: 386edc81-5f27-4e44-af7a-f5e47ded1327] deallocate_for_instance() {{(pid=53001) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1803}} [ 908.741241] nova-conductor[53002]: DEBUG nova.db.main.api [None req-adf07f4a-3bca-41f2-9a5f-debef055977c tempest-ServersNegativeTestMultiTenantJSON-819000951 tempest-ServersNegativeTestMultiTenantJSON-819000951-project-member] Created instance_extra for a878722d-7e36-4f15-8c5f-bd473375dd9b {{(pid=53002) instance_extra_update_by_uuid /opt/stack/nova/nova/db/main/api.py:2551}} [ 908.797042] nova-conductor[53001]: DEBUG nova.db.main.api [None req-e5837970-1bd9-42cd-9028-3a8d80878924 tempest-ServerMetadataNegativeTestJSON-2122666783 tempest-ServerMetadataNegativeTestJSON-2122666783-project-member] Created instance_extra for deffd52b-d708-4c46-a168-18e80b05b133 {{(pid=53001) instance_extra_update_by_uuid /opt/stack/nova/nova/db/main/api.py:2551}} [ 908.858432] nova-conductor[53002]: DEBUG nova.db.main.api [None req-34948935-a815-4d21-8ed3-ddfac054bc11 tempest-ServerTagsTestJSON-1582888721 tempest-ServerTagsTestJSON-1582888721-project-member] Created instance_extra for bf1694f2-6ad0-4e15-b05d-c73c24e0e955 {{(pid=53002) instance_extra_update_by_uuid /opt/stack/nova/nova/db/main/api.py:2551}} [ 908.891354] nova-conductor[53001]: DEBUG nova.network.neutron [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] [instance: 386edc81-5f27-4e44-af7a-f5e47ded1327] Instance cache missing network info. {{(pid=53001) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3323}} [ 908.897598] nova-conductor[53001]: DEBUG nova.network.neutron [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] [instance: 386edc81-5f27-4e44-af7a-f5e47ded1327] Updating instance_info_cache with network_info: [] {{(pid=53001) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} [ 908.912488] nova-conductor[53001]: DEBUG nova.db.main.api [None req-63ddf261-dc6a-42d1-841c-f112b680c721 tempest-TenantUsagesTestJSON-1233530310 tempest-TenantUsagesTestJSON-1233530310-project-member] Created instance_extra for 386edc81-5f27-4e44-af7a-f5e47ded1327 {{(pid=53001) instance_extra_update_by_uuid /opt/stack/nova/nova/db/main/api.py:2551}} [ 908.934303] nova-conductor[53002]: DEBUG nova.db.main.api [None req-7c9a00f6-9343-4899-83da-79ed712f6304 tempest-ServerActionsTestOtherB-1079721433 tempest-ServerActionsTestOtherB-1079721433-project-member] Created instance_extra for ecc4262d-6133-4541-aec8-fbee05180701 {{(pid=53002) instance_extra_update_by_uuid /opt/stack/nova/nova/db/main/api.py:2551}} [ 909.007922] nova-conductor[53001]: DEBUG nova.db.main.api [None req-eb5badd8-d0c4-4998-b0c5-30e887803cef tempest-ServerActionsV293TestJSON-390462293 tempest-ServerActionsV293TestJSON-390462293-project-member] Created instance_extra for c1b6b578-1bed-4e6c-8e7a-34c2e469cd80 {{(pid=53001) instance_extra_update_by_uuid /opt/stack/nova/nova/db/main/api.py:2551}} [ 909.063597] nova-conductor[53002]: DEBUG nova.db.main.api [None req-87481eb0-9c3c-4944-8961-f008b897cc07 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Created instance_extra for fd3e6440-74fc-4425-9b7e-571245ddc379 {{(pid=53002) instance_extra_update_by_uuid /opt/stack/nova/nova/db/main/api.py:2551}} [ 909.115470] nova-conductor[53001]: DEBUG nova.db.main.api [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Created instance_extra for fbf4b0bc-d87a-4063-87ef-e44f72ecbf5c {{(pid=53001) instance_extra_update_by_uuid /opt/stack/nova/nova/db/main/api.py:2551}} [ 909.172940] nova-conductor[53002]: DEBUG nova.db.main.api [None req-dba59053-e9d1-4c49-bf41-31c2f306dde2 tempest-MultipleCreateTestJSON-535747290 tempest-MultipleCreateTestJSON-535747290-project-member] Created instance_extra for 81c71aa0-9c68-407a-9bef-708c2cb70b12 {{(pid=53002) instance_extra_update_by_uuid /opt/stack/nova/nova/db/main/api.py:2551}} [ 909.230374] nova-conductor[53001]: DEBUG nova.db.main.api [None req-46fa9596-66bc-4024-b931-31353f9cf956 tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Created instance_extra for bdae41ee-e9c3-4272-9623-ca88464ec45a {{(pid=53001) instance_extra_update_by_uuid /opt/stack/nova/nova/db/main/api.py:2551}} [ 909.284218] nova-conductor[53002]: DEBUG nova.db.main.api [None req-cf73e27a-dcd0-427f-b470-9f587fb5df7d tempest-ServerRescueNegativeTestJSON-12688595 tempest-ServerRescueNegativeTestJSON-12688595-project-member] Created instance_extra for 3a0515f1-e61a-48d4-980d-49c7189dca2d {{(pid=53002) instance_extra_update_by_uuid /opt/stack/nova/nova/db/main/api.py:2551}} [ 912.763626] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-e57cb0b7-943b-4dff-b85d-94722ea01a65 tempest-ServerRescueTestJSON-1707014401 tempest-ServerRescueTestJSON-1707014401-project-member] Took 0.12 seconds to select destinations for 1 instance(s). {{(pid=53001) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:945}} [ 912.775117] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-e57cb0b7-943b-4dff-b85d-94722ea01a65 tempest-ServerRescueTestJSON-1707014401 tempest-ServerRescueTestJSON-1707014401-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 912.775435] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-e57cb0b7-943b-4dff-b85d-94722ea01a65 tempest-ServerRescueTestJSON-1707014401 tempest-ServerRescueTestJSON-1707014401-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 912.775661] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-e57cb0b7-943b-4dff-b85d-94722ea01a65 tempest-ServerRescueTestJSON-1707014401 tempest-ServerRescueTestJSON-1707014401-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 912.802883] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-e57cb0b7-943b-4dff-b85d-94722ea01a65 tempest-ServerRescueTestJSON-1707014401 tempest-ServerRescueTestJSON-1707014401-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 912.803142] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-e57cb0b7-943b-4dff-b85d-94722ea01a65 tempest-ServerRescueTestJSON-1707014401 tempest-ServerRescueTestJSON-1707014401-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 912.803369] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-e57cb0b7-943b-4dff-b85d-94722ea01a65 tempest-ServerRescueTestJSON-1707014401 tempest-ServerRescueTestJSON-1707014401-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 912.803804] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-e57cb0b7-943b-4dff-b85d-94722ea01a65 tempest-ServerRescueTestJSON-1707014401 tempest-ServerRescueTestJSON-1707014401-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 912.804043] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-e57cb0b7-943b-4dff-b85d-94722ea01a65 tempest-ServerRescueTestJSON-1707014401 tempest-ServerRescueTestJSON-1707014401-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 912.804332] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-e57cb0b7-943b-4dff-b85d-94722ea01a65 tempest-ServerRescueTestJSON-1707014401 tempest-ServerRescueTestJSON-1707014401-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 912.816556] nova-conductor[53001]: DEBUG nova.quota [None req-e57cb0b7-943b-4dff-b85d-94722ea01a65 tempest-ServerRescueTestJSON-1707014401 tempest-ServerRescueTestJSON-1707014401-project-member] Getting quotas for project 42dfcefd33194f5fb1356f7abc1cccad. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:393}} [ 912.819018] nova-conductor[53001]: DEBUG nova.quota [None req-e57cb0b7-943b-4dff-b85d-94722ea01a65 tempest-ServerRescueTestJSON-1707014401 tempest-ServerRescueTestJSON-1707014401-project-member] Getting quotas for user 6e5dbf4eaf1b4692b5269da912ef44fc and project 42dfcefd33194f5fb1356f7abc1cccad. Resources: {'instances', 'ram', 'cores'} {{(pid=53001) _get_quotas /opt/stack/nova/nova/quota.py:383}} [ 912.824928] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-e57cb0b7-943b-4dff-b85d-94722ea01a65 tempest-ServerRescueTestJSON-1707014401 tempest-ServerRescueTestJSON-1707014401-project-member] [instance: 3a4668ee-e420-4ad8-b638-95b3d55e00c1] Selected host: cpu-1; Selected node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28; Alternates: [] {{(pid=53001) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1761}} [ 912.825494] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-e57cb0b7-943b-4dff-b85d-94722ea01a65 tempest-ServerRescueTestJSON-1707014401 tempest-ServerRescueTestJSON-1707014401-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 912.825710] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-e57cb0b7-943b-4dff-b85d-94722ea01a65 tempest-ServerRescueTestJSON-1707014401 tempest-ServerRescueTestJSON-1707014401-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 912.825884] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-e57cb0b7-943b-4dff-b85d-94722ea01a65 tempest-ServerRescueTestJSON-1707014401 tempest-ServerRescueTestJSON-1707014401-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 912.829345] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-e57cb0b7-943b-4dff-b85d-94722ea01a65 tempest-ServerRescueTestJSON-1707014401 tempest-ServerRescueTestJSON-1707014401-project-member] [instance: 3a4668ee-e420-4ad8-b638-95b3d55e00c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 912.829621] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-e57cb0b7-943b-4dff-b85d-94722ea01a65 tempest-ServerRescueTestJSON-1707014401 tempest-ServerRescueTestJSON-1707014401-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 912.829855] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-e57cb0b7-943b-4dff-b85d-94722ea01a65 tempest-ServerRescueTestJSON-1707014401 tempest-ServerRescueTestJSON-1707014401-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 912.830043] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-e57cb0b7-943b-4dff-b85d-94722ea01a65 tempest-ServerRescueTestJSON-1707014401 tempest-ServerRescueTestJSON-1707014401-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 912.857233] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-e57cb0b7-943b-4dff-b85d-94722ea01a65 tempest-ServerRescueTestJSON-1707014401 tempest-ServerRescueTestJSON-1707014401-project-member] Acquiring lock "09b9d109-a207-40de-96b0-5d124568ab99" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 912.857547] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-e57cb0b7-943b-4dff-b85d-94722ea01a65 tempest-ServerRescueTestJSON-1707014401 tempest-ServerRescueTestJSON-1707014401-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 912.857737] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-e57cb0b7-943b-4dff-b85d-94722ea01a65 tempest-ServerRescueTestJSON-1707014401 tempest-ServerRescueTestJSON-1707014401-project-member] Lock "09b9d109-a207-40de-96b0-5d124568ab99" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 959.261619] nova-conductor[53001]: DEBUG nova.db.main.api [None req-d509edda-321c-4de0-9ca5-0b05c6399b67 tempest-InstanceActionsV221TestJSON-166999117 tempest-InstanceActionsV221TestJSON-166999117-project-member] Created instance_extra for 2751bdfb-2f28-48e0-98c2-f232ed6da6df {{(pid=53001) instance_extra_update_by_uuid /opt/stack/nova/nova/db/main/api.py:2551}} [ 959.644590] nova-conductor[53001]: ERROR nova.scheduler.utils [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] [instance: b14d8d3f-9253-4e5f-a5b8-09a2f43888a6] Error from last host: cpu-1 (node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28): ['Traceback (most recent call last):\n', ' File "/opt/stack/nova/nova/compute/manager.py", line 2611, in _build_and_run_instance\n self.driver.spawn(context, instance, image_meta,\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/driver.py", line 529, in spawn\n self._vmops.spawn(context, instance, image_meta, injected_files,\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 786, in spawn\n self._fetch_image_if_missing(context, vi)\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 639, in _fetch_image_if_missing\n image_cache(vi, tmp_image_ds_loc)\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 537, in _cache_sparse_image\n vm_util.copy_virtual_disk(\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vm_util.py", line 1423, in copy_virtual_disk\n session._wait_for_task(vmdk_copy_task)\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/session.py", line 157, in _wait_for_task\n return self.wait_for_task(task_ref)\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_vmware/api.py", line 398, in wait_for_task\n return evt.wait()\n', ' File "/usr/local/lib/python3.10/dist-packages/eventlet/event.py", line 125, in wait\n result = hub.switch()\n', ' File "/usr/local/lib/python3.10/dist-packages/eventlet/hubs/hub.py", line 313, in switch\n return self.greenlet.switch()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_vmware/common/loopingcall.py", line 75, in _inner\n self.f(*self.args, **self.kw)\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_vmware/api.py", line 448, in _poll_task\n raise exceptions.translate_fault(task_info.error)\n', "oslo_vmware.exceptions.VimFaultException: A specified parameter was not correct: fileType\nFaults: ['InvalidArgument']\n", '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', ' File "/opt/stack/nova/nova/compute/manager.py", line 2426, in _do_build_and_run_instance\n self._build_and_run_instance(context, instance, image,\n', ' File "/opt/stack/nova/nova/compute/manager.py", line 2718, in _build_and_run_instance\n raise exception.RescheduledException(\n', "nova.exception.RescheduledException: Build of instance b14d8d3f-9253-4e5f-a5b8-09a2f43888a6 was re-scheduled: A specified parameter was not correct: fileType\nFaults: ['InvalidArgument']\n"] [ 959.645349] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Rescheduling: True {{(pid=53001) build_instances /opt/stack/nova/nova/conductor/manager.py:695}} [ 959.645502] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Failed to compute_task_build_instances: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance b14d8d3f-9253-4e5f-a5b8-09a2f43888a6.: nova.exception.MaxRetriesExceeded: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance b14d8d3f-9253-4e5f-a5b8-09a2f43888a6. [ 959.645774] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] [instance: b14d8d3f-9253-4e5f-a5b8-09a2f43888a6] Setting instance to ERROR state.: nova.exception.MaxRetriesExceeded: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance b14d8d3f-9253-4e5f-a5b8-09a2f43888a6. [ 959.670385] nova-conductor[53001]: DEBUG nova.network.neutron [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] [instance: b14d8d3f-9253-4e5f-a5b8-09a2f43888a6] deallocate_for_instance() {{(pid=53001) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1803}} [ 959.690705] nova-conductor[53001]: DEBUG nova.network.neutron [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] [instance: b14d8d3f-9253-4e5f-a5b8-09a2f43888a6] Instance cache missing network info. {{(pid=53001) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3323}} [ 959.694155] nova-conductor[53001]: DEBUG nova.network.neutron [None req-b94bcd83-3081-4fd8-8d31-960a52aff5d3 tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] [instance: b14d8d3f-9253-4e5f-a5b8-09a2f43888a6] Updating instance_info_cache with network_info: [] {{(pid=53001) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} [ 960.225179] nova-conductor[53001]: DEBUG nova.db.main.api [None req-4b7be5c0-f76b-41bf-a3bd-40a889aab22d tempest-ServersV294TestFqdnHostnames-45939237 tempest-ServersV294TestFqdnHostnames-45939237-project-member] Created instance_extra for 83ecd8bb-ba2b-4151-986b-26f50b54e8e2 {{(pid=53001) instance_extra_update_by_uuid /opt/stack/nova/nova/db/main/api.py:2551}} [ 960.914752] nova-conductor[53001]: DEBUG nova.db.main.api [None req-0c8ec332-5019-4190-91b8-9f74d2637704 tempest-VolumesAdminNegativeTest-1171589411 tempest-VolumesAdminNegativeTest-1171589411-project-member] Created instance_extra for afb2cdc1-74ec-4d08-85cb-e96b4071f661 {{(pid=53001) instance_extra_update_by_uuid /opt/stack/nova/nova/db/main/api.py:2551}} [ 961.218440] nova-conductor[53001]: DEBUG nova.db.main.api [None req-eb90076f-127d-4345-af44-bfa8dc28fd29 tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Created instance_extra for 2f252e1d-bd99-4d70-a8ab-b3f9ce8ab9b5 {{(pid=53001) instance_extra_update_by_uuid /opt/stack/nova/nova/db/main/api.py:2551}} [ 962.098865] nova-conductor[53002]: DEBUG nova.db.main.api [None req-742b174a-c430-401c-9610-59b04ea9602b tempest-SecurityGroupsTestJSON-1924620447 tempest-SecurityGroupsTestJSON-1924620447-project-member] Created instance_extra for be11788c-634f-40c0-8c8c-d6253d0e68ad {{(pid=53002) instance_extra_update_by_uuid /opt/stack/nova/nova/db/main/api.py:2551}} [ 962.926125] nova-conductor[53002]: DEBUG nova.db.main.api [None req-ea692a03-b680-4082-a4d3-36b28076ef4d tempest-ListImageFiltersTestJSON-1294019059 tempest-ListImageFiltersTestJSON-1294019059-project-member] Created instance_extra for 306f3cb9-3028-4ff2-8090-2c9c1c72efc1 {{(pid=53002) instance_extra_update_by_uuid /opt/stack/nova/nova/db/main/api.py:2551}} [ 963.963334] nova-conductor[53001]: DEBUG nova.db.main.api [None req-0cce2017-52b4-498d-9162-f2d06a7fc921 tempest-DeleteServersTestJSON-455906324 tempest-DeleteServersTestJSON-455906324-project-member] Created instance_extra for 46737200-2da8-41ee-b33e-3bb6cc3e4618 {{(pid=53001) instance_extra_update_by_uuid /opt/stack/nova/nova/db/main/api.py:2551}} [ 964.286836] nova-conductor[53001]: DEBUG nova.db.main.api [None req-85a6e488-4ff9-4b22-885a-af1c2c6ff65c tempest-ImagesNegativeTestJSON-1588877586 tempest-ImagesNegativeTestJSON-1588877586-project-member] Created instance_extra for 6774e2f5-99d0-4dc9-9ac0-188b35bd68a2 {{(pid=53001) instance_extra_update_by_uuid /opt/stack/nova/nova/db/main/api.py:2551}} [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager [None req-807aae6e-61dc-47ab-90ab-2b8fe73a61da tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 968.031045] nova-conductor[53002]: Traceback (most recent call last): [ 968.031045] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 968.031045] nova-conductor[53002]: return func(*args, **kwargs) [ 968.031045] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 968.031045] nova-conductor[53002]: selections = self._select_destinations( [ 968.031045] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 968.031045] nova-conductor[53002]: selections = self._schedule( [ 968.031045] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 968.031045] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 968.031045] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 968.031045] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 968.031045] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager [ 968.031045] nova-conductor[53002]: ERROR nova.conductor.manager [ 968.038795] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-807aae6e-61dc-47ab-90ab-2b8fe73a61da tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 968.039056] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-807aae6e-61dc-47ab-90ab-2b8fe73a61da tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 968.039274] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-807aae6e-61dc-47ab-90ab-2b8fe73a61da tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 968.088054] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-807aae6e-61dc-47ab-90ab-2b8fe73a61da tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] [instance: 48bf3268-a4ee-42a9-ae32-bb5eacfdf6fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 968.088891] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-807aae6e-61dc-47ab-90ab-2b8fe73a61da tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 968.089153] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-807aae6e-61dc-47ab-90ab-2b8fe73a61da tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 968.089351] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-807aae6e-61dc-47ab-90ab-2b8fe73a61da tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 968.092788] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-807aae6e-61dc-47ab-90ab-2b8fe73a61da tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 968.092788] nova-conductor[53002]: Traceback (most recent call last): [ 968.092788] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 968.092788] nova-conductor[53002]: return func(*args, **kwargs) [ 968.092788] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 968.092788] nova-conductor[53002]: selections = self._select_destinations( [ 968.092788] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 968.092788] nova-conductor[53002]: selections = self._schedule( [ 968.092788] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 968.092788] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 968.092788] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 968.092788] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 968.092788] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 968.092788] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 968.093554] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-807aae6e-61dc-47ab-90ab-2b8fe73a61da tempest-ServersTestMultiNic-1533444800 tempest-ServersTestMultiNic-1533444800-project-member] [instance: 48bf3268-a4ee-42a9-ae32-bb5eacfdf6fb] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager [None req-d6c54955-e7b8-4c45-973d-997c14575a2e tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 978.654758] nova-conductor[53002]: Traceback (most recent call last): [ 978.654758] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 978.654758] nova-conductor[53002]: return func(*args, **kwargs) [ 978.654758] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 978.654758] nova-conductor[53002]: selections = self._select_destinations( [ 978.654758] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 978.654758] nova-conductor[53002]: selections = self._schedule( [ 978.654758] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 978.654758] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 978.654758] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 978.654758] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 978.654758] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager [ 978.654758] nova-conductor[53002]: ERROR nova.conductor.manager [ 978.661490] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-d6c54955-e7b8-4c45-973d-997c14575a2e tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 978.661721] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-d6c54955-e7b8-4c45-973d-997c14575a2e tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 978.661894] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-d6c54955-e7b8-4c45-973d-997c14575a2e tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 978.708018] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-d6c54955-e7b8-4c45-973d-997c14575a2e tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] [instance: 15c7f677-4e54-420e-91be-98ef9e892ea6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 978.708295] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-d6c54955-e7b8-4c45-973d-997c14575a2e tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 978.710130] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-d6c54955-e7b8-4c45-973d-997c14575a2e tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 978.710130] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-d6c54955-e7b8-4c45-973d-997c14575a2e tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 978.711618] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-d6c54955-e7b8-4c45-973d-997c14575a2e tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 978.711618] nova-conductor[53002]: Traceback (most recent call last): [ 978.711618] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 978.711618] nova-conductor[53002]: return func(*args, **kwargs) [ 978.711618] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 978.711618] nova-conductor[53002]: selections = self._select_destinations( [ 978.711618] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 978.711618] nova-conductor[53002]: selections = self._schedule( [ 978.711618] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 978.711618] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 978.711618] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 978.711618] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 978.711618] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 978.711618] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 978.712253] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-d6c54955-e7b8-4c45-973d-997c14575a2e tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] [instance: 15c7f677-4e54-420e-91be-98ef9e892ea6] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager [None req-4ed749fa-5419-4102-b7cf-1657b57fe9f8 tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 981.692470] nova-conductor[53001]: Traceback (most recent call last): [ 981.692470] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 981.692470] nova-conductor[53001]: return func(*args, **kwargs) [ 981.692470] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 981.692470] nova-conductor[53001]: selections = self._select_destinations( [ 981.692470] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 981.692470] nova-conductor[53001]: selections = self._schedule( [ 981.692470] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 981.692470] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 981.692470] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 981.692470] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 981.692470] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager [ 981.692470] nova-conductor[53001]: ERROR nova.conductor.manager [ 981.700544] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-4ed749fa-5419-4102-b7cf-1657b57fe9f8 tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 981.700825] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-4ed749fa-5419-4102-b7cf-1657b57fe9f8 tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 981.701025] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-4ed749fa-5419-4102-b7cf-1657b57fe9f8 tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 981.748936] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-4ed749fa-5419-4102-b7cf-1657b57fe9f8 tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] [instance: 596b97b1-1959-4247-8ce5-0a6c992c695e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 981.749795] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-4ed749fa-5419-4102-b7cf-1657b57fe9f8 tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 981.750040] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-4ed749fa-5419-4102-b7cf-1657b57fe9f8 tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 981.750222] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-4ed749fa-5419-4102-b7cf-1657b57fe9f8 tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 981.756806] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-4ed749fa-5419-4102-b7cf-1657b57fe9f8 tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 981.756806] nova-conductor[53001]: Traceback (most recent call last): [ 981.756806] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 981.756806] nova-conductor[53001]: return func(*args, **kwargs) [ 981.756806] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 981.756806] nova-conductor[53001]: selections = self._select_destinations( [ 981.756806] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 981.756806] nova-conductor[53001]: selections = self._schedule( [ 981.756806] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 981.756806] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 981.756806] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 981.756806] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 981.756806] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 981.756806] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 981.757462] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-4ed749fa-5419-4102-b7cf-1657b57fe9f8 tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] [instance: 596b97b1-1959-4247-8ce5-0a6c992c695e] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager [None req-693d095b-a0c4-425c-ae16-d34cb6bfc67e tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 985.115688] nova-conductor[53002]: Traceback (most recent call last): [ 985.115688] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 985.115688] nova-conductor[53002]: return func(*args, **kwargs) [ 985.115688] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 985.115688] nova-conductor[53002]: selections = self._select_destinations( [ 985.115688] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 985.115688] nova-conductor[53002]: selections = self._schedule( [ 985.115688] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 985.115688] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 985.115688] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 985.115688] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 985.115688] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager [ 985.115688] nova-conductor[53002]: ERROR nova.conductor.manager [ 985.122555] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-693d095b-a0c4-425c-ae16-d34cb6bfc67e tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 985.122817] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-693d095b-a0c4-425c-ae16-d34cb6bfc67e tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 985.122993] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-693d095b-a0c4-425c-ae16-d34cb6bfc67e tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 985.158618] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-693d095b-a0c4-425c-ae16-d34cb6bfc67e tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] [instance: e48551e3-a91d-49f1-bc7b-b8003e267574] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 985.159327] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-693d095b-a0c4-425c-ae16-d34cb6bfc67e tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 985.159538] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-693d095b-a0c4-425c-ae16-d34cb6bfc67e tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 985.159707] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-693d095b-a0c4-425c-ae16-d34cb6bfc67e tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 985.162597] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-693d095b-a0c4-425c-ae16-d34cb6bfc67e tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 985.162597] nova-conductor[53002]: Traceback (most recent call last): [ 985.162597] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 985.162597] nova-conductor[53002]: return func(*args, **kwargs) [ 985.162597] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 985.162597] nova-conductor[53002]: selections = self._select_destinations( [ 985.162597] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 985.162597] nova-conductor[53002]: selections = self._schedule( [ 985.162597] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 985.162597] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 985.162597] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 985.162597] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 985.162597] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 985.162597] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 985.163174] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-693d095b-a0c4-425c-ae16-d34cb6bfc67e tempest-AttachVolumeNegativeTest-1762816992 tempest-AttachVolumeNegativeTest-1762816992-project-member] [instance: e48551e3-a91d-49f1-bc7b-b8003e267574] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1013.249557] nova-conductor[53001]: DEBUG nova.db.main.api [None req-9bf5722c-1236-4b33-8006-6c056614262c tempest-DeleteServersAdminTestJSON-523328319 tempest-DeleteServersAdminTestJSON-523328319-project-member] Created instance_extra for 30cf201d-7a1c-479c-9040-fba38726d9ab {{(pid=53001) instance_extra_update_by_uuid /opt/stack/nova/nova/db/main/api.py:2551}} [ 1063.667974] nova-conductor[53001]: ERROR nova.scheduler.utils [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] [instance: 585e3015-faef-40df-b3dd-04d2c8e4dd00] Error from last host: cpu-1 (node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28): ['Traceback (most recent call last):\n', ' File "/opt/stack/nova/nova/compute/manager.py", line 2611, in _build_and_run_instance\n self.driver.spawn(context, instance, image_meta,\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/driver.py", line 529, in spawn\n self._vmops.spawn(context, instance, image_meta, injected_files,\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 786, in spawn\n self._fetch_image_if_missing(context, vi)\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 639, in _fetch_image_if_missing\n image_cache(vi, tmp_image_ds_loc)\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 537, in _cache_sparse_image\n vm_util.copy_virtual_disk(\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/vm_util.py", line 1423, in copy_virtual_disk\n session._wait_for_task(vmdk_copy_task)\n', ' File "/opt/stack/nova/nova/virt/vmwareapi/session.py", line 157, in _wait_for_task\n return self.wait_for_task(task_ref)\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_vmware/api.py", line 398, in wait_for_task\n return evt.wait()\n', ' File "/usr/local/lib/python3.10/dist-packages/eventlet/event.py", line 125, in wait\n result = hub.switch()\n', ' File "/usr/local/lib/python3.10/dist-packages/eventlet/hubs/hub.py", line 313, in switch\n return self.greenlet.switch()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_vmware/common/loopingcall.py", line 75, in _inner\n self.f(*self.args, **self.kw)\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_vmware/api.py", line 448, in _poll_task\n raise exceptions.translate_fault(task_info.error)\n', "oslo_vmware.exceptions.VimFaultException: A specified parameter was not correct: fileType\nFaults: ['InvalidArgument']\n", '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', ' File "/opt/stack/nova/nova/compute/manager.py", line 2426, in _do_build_and_run_instance\n self._build_and_run_instance(context, instance, image,\n', ' File "/opt/stack/nova/nova/compute/manager.py", line 2718, in _build_and_run_instance\n raise exception.RescheduledException(\n', "nova.exception.RescheduledException: Build of instance 585e3015-faef-40df-b3dd-04d2c8e4dd00 was re-scheduled: A specified parameter was not correct: fileType\nFaults: ['InvalidArgument']\n"] [ 1063.668437] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] Rescheduling: True {{(pid=53001) build_instances /opt/stack/nova/nova/conductor/manager.py:695}} [ 1063.668437] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] Failed to compute_task_build_instances: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 585e3015-faef-40df-b3dd-04d2c8e4dd00.: nova.exception.MaxRetriesExceeded: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 585e3015-faef-40df-b3dd-04d2c8e4dd00. [ 1063.669088] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] [instance: 585e3015-faef-40df-b3dd-04d2c8e4dd00] Setting instance to ERROR state.: nova.exception.MaxRetriesExceeded: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 585e3015-faef-40df-b3dd-04d2c8e4dd00. [ 1063.689541] nova-conductor[53001]: DEBUG nova.network.neutron [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] [instance: 585e3015-faef-40df-b3dd-04d2c8e4dd00] deallocate_for_instance() {{(pid=53001) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1803}} [ 1063.709603] nova-conductor[53001]: DEBUG nova.network.neutron [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] [instance: 585e3015-faef-40df-b3dd-04d2c8e4dd00] Instance cache missing network info. {{(pid=53001) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3323}} [ 1063.713374] nova-conductor[53001]: DEBUG nova.network.neutron [None req-ba991eed-553c-44e0-b30c-89e88793c3a2 tempest-ServersNegativeTestJSON-1737616329 tempest-ServersNegativeTestJSON-1737616329-project-member] [instance: 585e3015-faef-40df-b3dd-04d2c8e4dd00] Updating instance_info_cache with network_info: [] {{(pid=53001) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager [None req-4c3a0084-fe17-4706-889f-58033350fb6a tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1072.809153] nova-conductor[53001]: Traceback (most recent call last): [ 1072.809153] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1072.809153] nova-conductor[53001]: return func(*args, **kwargs) [ 1072.809153] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1072.809153] nova-conductor[53001]: selections = self._select_destinations( [ 1072.809153] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1072.809153] nova-conductor[53001]: selections = self._schedule( [ 1072.809153] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1072.809153] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 1072.809153] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1072.809153] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 1072.809153] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager [ 1072.809153] nova-conductor[53001]: ERROR nova.conductor.manager [ 1072.815603] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-4c3a0084-fe17-4706-889f-58033350fb6a tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1072.815835] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-4c3a0084-fe17-4706-889f-58033350fb6a tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1072.816017] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-4c3a0084-fe17-4706-889f-58033350fb6a tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1072.861898] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-4c3a0084-fe17-4706-889f-58033350fb6a tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] [instance: efa98b30-9314-470b-a7cb-3d0b533a5dd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 1072.862640] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-4c3a0084-fe17-4706-889f-58033350fb6a tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1072.862859] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-4c3a0084-fe17-4706-889f-58033350fb6a tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1072.863108] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-4c3a0084-fe17-4706-889f-58033350fb6a tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1072.866576] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-4c3a0084-fe17-4706-889f-58033350fb6a tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 1072.866576] nova-conductor[53001]: Traceback (most recent call last): [ 1072.866576] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1072.866576] nova-conductor[53001]: return func(*args, **kwargs) [ 1072.866576] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1072.866576] nova-conductor[53001]: selections = self._select_destinations( [ 1072.866576] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1072.866576] nova-conductor[53001]: selections = self._schedule( [ 1072.866576] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1072.866576] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 1072.866576] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1072.866576] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 1072.866576] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1072.866576] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1072.867480] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-4c3a0084-fe17-4706-889f-58033350fb6a tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] [instance: efa98b30-9314-470b-a7cb-3d0b533a5dd3] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager [None req-2bebc839-a62b-4aa1-9314-a8bb8cb9166c tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1074.700379] nova-conductor[53002]: Traceback (most recent call last): [ 1074.700379] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1074.700379] nova-conductor[53002]: return func(*args, **kwargs) [ 1074.700379] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1074.700379] nova-conductor[53002]: selections = self._select_destinations( [ 1074.700379] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1074.700379] nova-conductor[53002]: selections = self._schedule( [ 1074.700379] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1074.700379] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 1074.700379] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1074.700379] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 1074.700379] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager [ 1074.700379] nova-conductor[53002]: ERROR nova.conductor.manager [ 1074.707483] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-2bebc839-a62b-4aa1-9314-a8bb8cb9166c tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1074.707723] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-2bebc839-a62b-4aa1-9314-a8bb8cb9166c tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1074.707899] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-2bebc839-a62b-4aa1-9314-a8bb8cb9166c tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1074.749219] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-2bebc839-a62b-4aa1-9314-a8bb8cb9166c tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] [instance: 4ced50b3-0822-4472-89ab-ab3824654ca0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 1074.749962] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-2bebc839-a62b-4aa1-9314-a8bb8cb9166c tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1074.750240] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-2bebc839-a62b-4aa1-9314-a8bb8cb9166c tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1074.750420] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-2bebc839-a62b-4aa1-9314-a8bb8cb9166c tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1074.753619] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-2bebc839-a62b-4aa1-9314-a8bb8cb9166c tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 1074.753619] nova-conductor[53002]: Traceback (most recent call last): [ 1074.753619] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1074.753619] nova-conductor[53002]: return func(*args, **kwargs) [ 1074.753619] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1074.753619] nova-conductor[53002]: selections = self._select_destinations( [ 1074.753619] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1074.753619] nova-conductor[53002]: selections = self._schedule( [ 1074.753619] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1074.753619] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 1074.753619] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1074.753619] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 1074.753619] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1074.753619] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1074.754241] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-2bebc839-a62b-4aa1-9314-a8bb8cb9166c tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] [instance: 4ced50b3-0822-4472-89ab-ab3824654ca0] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager [None req-f3190f74-7ef4-4a24-b632-70cfa0504c6c tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1076.516314] nova-conductor[53001]: Traceback (most recent call last): [ 1076.516314] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1076.516314] nova-conductor[53001]: return func(*args, **kwargs) [ 1076.516314] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1076.516314] nova-conductor[53001]: selections = self._select_destinations( [ 1076.516314] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1076.516314] nova-conductor[53001]: selections = self._schedule( [ 1076.516314] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1076.516314] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 1076.516314] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1076.516314] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 1076.516314] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager [ 1076.516314] nova-conductor[53001]: ERROR nova.conductor.manager [ 1076.522777] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f3190f74-7ef4-4a24-b632-70cfa0504c6c tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1076.522999] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f3190f74-7ef4-4a24-b632-70cfa0504c6c tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1076.523197] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f3190f74-7ef4-4a24-b632-70cfa0504c6c tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1076.564700] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-f3190f74-7ef4-4a24-b632-70cfa0504c6c tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] [instance: 1dddbed0-176a-492a-8022-79814c9f9b08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 1076.565401] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f3190f74-7ef4-4a24-b632-70cfa0504c6c tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1076.565615] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f3190f74-7ef4-4a24-b632-70cfa0504c6c tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1076.565788] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-f3190f74-7ef4-4a24-b632-70cfa0504c6c tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1076.568720] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-f3190f74-7ef4-4a24-b632-70cfa0504c6c tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 1076.568720] nova-conductor[53001]: Traceback (most recent call last): [ 1076.568720] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1076.568720] nova-conductor[53001]: return func(*args, **kwargs) [ 1076.568720] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1076.568720] nova-conductor[53001]: selections = self._select_destinations( [ 1076.568720] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1076.568720] nova-conductor[53001]: selections = self._schedule( [ 1076.568720] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1076.568720] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 1076.568720] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1076.568720] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 1076.568720] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1076.568720] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1076.569408] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-f3190f74-7ef4-4a24-b632-70cfa0504c6c tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] [instance: 1dddbed0-176a-492a-8022-79814c9f9b08] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager [None req-04b2141c-bbb0-4a04-8355-4b7896dc0ce9 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1078.506701] nova-conductor[53002]: Traceback (most recent call last): [ 1078.506701] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1078.506701] nova-conductor[53002]: return func(*args, **kwargs) [ 1078.506701] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1078.506701] nova-conductor[53002]: selections = self._select_destinations( [ 1078.506701] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1078.506701] nova-conductor[53002]: selections = self._schedule( [ 1078.506701] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1078.506701] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 1078.506701] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1078.506701] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 1078.506701] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager [ 1078.506701] nova-conductor[53002]: ERROR nova.conductor.manager [ 1078.515600] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-04b2141c-bbb0-4a04-8355-4b7896dc0ce9 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1078.515832] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-04b2141c-bbb0-4a04-8355-4b7896dc0ce9 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1078.515998] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-04b2141c-bbb0-4a04-8355-4b7896dc0ce9 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1078.556104] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-04b2141c-bbb0-4a04-8355-4b7896dc0ce9 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] [instance: 081d8906-853a-47b8-a8f2-7d4db0193279] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 1078.556855] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-04b2141c-bbb0-4a04-8355-4b7896dc0ce9 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1078.557173] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-04b2141c-bbb0-4a04-8355-4b7896dc0ce9 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1078.557522] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-04b2141c-bbb0-4a04-8355-4b7896dc0ce9 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1078.560677] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-04b2141c-bbb0-4a04-8355-4b7896dc0ce9 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 1078.560677] nova-conductor[53002]: Traceback (most recent call last): [ 1078.560677] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1078.560677] nova-conductor[53002]: return func(*args, **kwargs) [ 1078.560677] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1078.560677] nova-conductor[53002]: selections = self._select_destinations( [ 1078.560677] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1078.560677] nova-conductor[53002]: selections = self._schedule( [ 1078.560677] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1078.560677] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 1078.560677] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1078.560677] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 1078.560677] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1078.560677] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1078.561272] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-04b2141c-bbb0-4a04-8355-4b7896dc0ce9 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] [instance: 081d8906-853a-47b8-a8f2-7d4db0193279] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager [None req-591036bc-3823-4d56-8d0e-8ef8bdaf3c54 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1079.884533] nova-conductor[53001]: Traceback (most recent call last): [ 1079.884533] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1079.884533] nova-conductor[53001]: return func(*args, **kwargs) [ 1079.884533] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1079.884533] nova-conductor[53001]: selections = self._select_destinations( [ 1079.884533] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1079.884533] nova-conductor[53001]: selections = self._schedule( [ 1079.884533] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1079.884533] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 1079.884533] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1079.884533] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 1079.884533] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager [ 1079.884533] nova-conductor[53001]: ERROR nova.conductor.manager [ 1079.891083] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-591036bc-3823-4d56-8d0e-8ef8bdaf3c54 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1079.891332] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-591036bc-3823-4d56-8d0e-8ef8bdaf3c54 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1079.891509] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-591036bc-3823-4d56-8d0e-8ef8bdaf3c54 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1079.934967] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-591036bc-3823-4d56-8d0e-8ef8bdaf3c54 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] [instance: 72d00dd8-7d22-495b-97f7-910b3e0c8b06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 1079.935695] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-591036bc-3823-4d56-8d0e-8ef8bdaf3c54 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1079.935908] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-591036bc-3823-4d56-8d0e-8ef8bdaf3c54 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1079.936094] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-591036bc-3823-4d56-8d0e-8ef8bdaf3c54 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1079.941298] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-591036bc-3823-4d56-8d0e-8ef8bdaf3c54 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 1079.941298] nova-conductor[53001]: Traceback (most recent call last): [ 1079.941298] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1079.941298] nova-conductor[53001]: return func(*args, **kwargs) [ 1079.941298] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1079.941298] nova-conductor[53001]: selections = self._select_destinations( [ 1079.941298] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1079.941298] nova-conductor[53001]: selections = self._schedule( [ 1079.941298] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1079.941298] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 1079.941298] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1079.941298] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 1079.941298] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1079.941298] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1079.941819] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-591036bc-3823-4d56-8d0e-8ef8bdaf3c54 tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] [instance: 72d00dd8-7d22-495b-97f7-910b3e0c8b06] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager [None req-e1d0af13-28e6-4d7e-90ef-a9a92b46cbfb tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1082.396286] nova-conductor[53002]: Traceback (most recent call last): [ 1082.396286] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1082.396286] nova-conductor[53002]: return func(*args, **kwargs) [ 1082.396286] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1082.396286] nova-conductor[53002]: selections = self._select_destinations( [ 1082.396286] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1082.396286] nova-conductor[53002]: selections = self._schedule( [ 1082.396286] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1082.396286] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 1082.396286] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1082.396286] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 1082.396286] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager [ 1082.396286] nova-conductor[53002]: ERROR nova.conductor.manager [ 1082.408938] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e1d0af13-28e6-4d7e-90ef-a9a92b46cbfb tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1082.409276] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e1d0af13-28e6-4d7e-90ef-a9a92b46cbfb tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1082.409461] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e1d0af13-28e6-4d7e-90ef-a9a92b46cbfb tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1082.462972] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-e1d0af13-28e6-4d7e-90ef-a9a92b46cbfb tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] [instance: c13a4388-9aec-40fd-a886-4005d9c41c84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 1082.463820] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e1d0af13-28e6-4d7e-90ef-a9a92b46cbfb tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1082.464212] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e1d0af13-28e6-4d7e-90ef-a9a92b46cbfb tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1082.464212] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-e1d0af13-28e6-4d7e-90ef-a9a92b46cbfb tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1082.467751] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-e1d0af13-28e6-4d7e-90ef-a9a92b46cbfb tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 1082.467751] nova-conductor[53002]: Traceback (most recent call last): [ 1082.467751] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1082.467751] nova-conductor[53002]: return func(*args, **kwargs) [ 1082.467751] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1082.467751] nova-conductor[53002]: selections = self._select_destinations( [ 1082.467751] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1082.467751] nova-conductor[53002]: selections = self._schedule( [ 1082.467751] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1082.467751] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 1082.467751] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1082.467751] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 1082.467751] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1082.467751] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1082.468268] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-e1d0af13-28e6-4d7e-90ef-a9a92b46cbfb tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] [instance: c13a4388-9aec-40fd-a886-4005d9c41c84] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager [None req-c0619972-cfc8-432d-9101-0d2509fc506d tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1082.554610] nova-conductor[53001]: Traceback (most recent call last): [ 1082.554610] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1082.554610] nova-conductor[53001]: return func(*args, **kwargs) [ 1082.554610] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1082.554610] nova-conductor[53001]: selections = self._select_destinations( [ 1082.554610] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1082.554610] nova-conductor[53001]: selections = self._schedule( [ 1082.554610] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1082.554610] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 1082.554610] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1082.554610] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 1082.554610] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager [ 1082.554610] nova-conductor[53001]: ERROR nova.conductor.manager [ 1082.563561] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-c0619972-cfc8-432d-9101-0d2509fc506d tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1082.563790] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-c0619972-cfc8-432d-9101-0d2509fc506d tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1082.563959] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-c0619972-cfc8-432d-9101-0d2509fc506d tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1082.627222] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-c0619972-cfc8-432d-9101-0d2509fc506d tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] [instance: 1d140511-a769-4ae6-b90d-f6c02437197a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 1082.627925] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-c0619972-cfc8-432d-9101-0d2509fc506d tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1082.628160] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-c0619972-cfc8-432d-9101-0d2509fc506d tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1082.628340] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-c0619972-cfc8-432d-9101-0d2509fc506d tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1082.631796] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-c0619972-cfc8-432d-9101-0d2509fc506d tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 1082.631796] nova-conductor[53001]: Traceback (most recent call last): [ 1082.631796] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1082.631796] nova-conductor[53001]: return func(*args, **kwargs) [ 1082.631796] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1082.631796] nova-conductor[53001]: selections = self._select_destinations( [ 1082.631796] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1082.631796] nova-conductor[53001]: selections = self._schedule( [ 1082.631796] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1082.631796] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 1082.631796] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1082.631796] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 1082.631796] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1082.631796] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1082.632361] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-c0619972-cfc8-432d-9101-0d2509fc506d tempest-AttachVolumeTestJSON-958325147 tempest-AttachVolumeTestJSON-958325147-project-member] [instance: 1d140511-a769-4ae6-b90d-f6c02437197a] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager [None req-2462820b-89b0-4329-8894-d5cdbfa0b2f2 tempest-ServersAaction247Test-585086689 tempest-ServersAaction247Test-585086689-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1083.159286] nova-conductor[53002]: Traceback (most recent call last): [ 1083.159286] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1083.159286] nova-conductor[53002]: return func(*args, **kwargs) [ 1083.159286] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1083.159286] nova-conductor[53002]: selections = self._select_destinations( [ 1083.159286] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1083.159286] nova-conductor[53002]: selections = self._schedule( [ 1083.159286] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1083.159286] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 1083.159286] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1083.159286] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 1083.159286] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager [ 1083.159286] nova-conductor[53002]: ERROR nova.conductor.manager [ 1083.166398] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-2462820b-89b0-4329-8894-d5cdbfa0b2f2 tempest-ServersAaction247Test-585086689 tempest-ServersAaction247Test-585086689-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1083.166811] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-2462820b-89b0-4329-8894-d5cdbfa0b2f2 tempest-ServersAaction247Test-585086689 tempest-ServersAaction247Test-585086689-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1083.167211] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-2462820b-89b0-4329-8894-d5cdbfa0b2f2 tempest-ServersAaction247Test-585086689 tempest-ServersAaction247Test-585086689-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1083.219938] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-2462820b-89b0-4329-8894-d5cdbfa0b2f2 tempest-ServersAaction247Test-585086689 tempest-ServersAaction247Test-585086689-project-member] [instance: e1e04e35-99ed-4e01-bb41-51c185f00109] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 1083.219938] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-2462820b-89b0-4329-8894-d5cdbfa0b2f2 tempest-ServersAaction247Test-585086689 tempest-ServersAaction247Test-585086689-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1083.219938] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-2462820b-89b0-4329-8894-d5cdbfa0b2f2 tempest-ServersAaction247Test-585086689 tempest-ServersAaction247Test-585086689-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1083.219938] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-2462820b-89b0-4329-8894-d5cdbfa0b2f2 tempest-ServersAaction247Test-585086689 tempest-ServersAaction247Test-585086689-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1083.226240] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-2462820b-89b0-4329-8894-d5cdbfa0b2f2 tempest-ServersAaction247Test-585086689 tempest-ServersAaction247Test-585086689-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 1083.226240] nova-conductor[53002]: Traceback (most recent call last): [ 1083.226240] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1083.226240] nova-conductor[53002]: return func(*args, **kwargs) [ 1083.226240] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1083.226240] nova-conductor[53002]: selections = self._select_destinations( [ 1083.226240] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1083.226240] nova-conductor[53002]: selections = self._schedule( [ 1083.226240] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1083.226240] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 1083.226240] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1083.226240] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 1083.226240] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1083.226240] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1083.226240] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-2462820b-89b0-4329-8894-d5cdbfa0b2f2 tempest-ServersAaction247Test-585086689 tempest-ServersAaction247Test-585086689-project-member] [instance: e1e04e35-99ed-4e01-bb41-51c185f00109] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager [None req-179c8475-417c-4aa1-8716-a96868c1e2b1 tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1083.677352] nova-conductor[53001]: Traceback (most recent call last): [ 1083.677352] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1083.677352] nova-conductor[53001]: return func(*args, **kwargs) [ 1083.677352] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1083.677352] nova-conductor[53001]: selections = self._select_destinations( [ 1083.677352] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1083.677352] nova-conductor[53001]: selections = self._schedule( [ 1083.677352] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1083.677352] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 1083.677352] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1083.677352] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 1083.677352] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager [ 1083.677352] nova-conductor[53001]: ERROR nova.conductor.manager [ 1083.683468] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-179c8475-417c-4aa1-8716-a96868c1e2b1 tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1083.683872] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-179c8475-417c-4aa1-8716-a96868c1e2b1 tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1083.684926] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-179c8475-417c-4aa1-8716-a96868c1e2b1 tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1083.733660] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-179c8475-417c-4aa1-8716-a96868c1e2b1 tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] [instance: 09d39720-c279-4792-9fad-2a39dd8c110f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 1083.733660] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-179c8475-417c-4aa1-8716-a96868c1e2b1 tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1083.733660] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-179c8475-417c-4aa1-8716-a96868c1e2b1 tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1083.733660] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-179c8475-417c-4aa1-8716-a96868c1e2b1 tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1083.737363] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-179c8475-417c-4aa1-8716-a96868c1e2b1 tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 1083.737363] nova-conductor[53001]: Traceback (most recent call last): [ 1083.737363] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1083.737363] nova-conductor[53001]: return func(*args, **kwargs) [ 1083.737363] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1083.737363] nova-conductor[53001]: selections = self._select_destinations( [ 1083.737363] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1083.737363] nova-conductor[53001]: selections = self._schedule( [ 1083.737363] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1083.737363] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 1083.737363] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1083.737363] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 1083.737363] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1083.737363] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1083.738457] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-179c8475-417c-4aa1-8716-a96868c1e2b1 tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] [instance: 09d39720-c279-4792-9fad-2a39dd8c110f] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager [None req-8628a655-7974-4423-b6f4-73ec52291ffa tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1084.162746] nova-conductor[53002]: Traceback (most recent call last): [ 1084.162746] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1084.162746] nova-conductor[53002]: return func(*args, **kwargs) [ 1084.162746] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1084.162746] nova-conductor[53002]: selections = self._select_destinations( [ 1084.162746] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1084.162746] nova-conductor[53002]: selections = self._schedule( [ 1084.162746] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1084.162746] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 1084.162746] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1084.162746] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 1084.162746] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager [ 1084.162746] nova-conductor[53002]: ERROR nova.conductor.manager [ 1084.169687] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-8628a655-7974-4423-b6f4-73ec52291ffa tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1084.169935] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-8628a655-7974-4423-b6f4-73ec52291ffa tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1084.170186] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-8628a655-7974-4423-b6f4-73ec52291ffa tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1084.220635] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-8628a655-7974-4423-b6f4-73ec52291ffa tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] [instance: a892bb58-6df2-485f-ad91-ce4003739ea7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 1084.221395] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-8628a655-7974-4423-b6f4-73ec52291ffa tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1084.221625] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-8628a655-7974-4423-b6f4-73ec52291ffa tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1084.221798] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-8628a655-7974-4423-b6f4-73ec52291ffa tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1084.225967] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-8628a655-7974-4423-b6f4-73ec52291ffa tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 1084.225967] nova-conductor[53002]: Traceback (most recent call last): [ 1084.225967] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1084.225967] nova-conductor[53002]: return func(*args, **kwargs) [ 1084.225967] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1084.225967] nova-conductor[53002]: selections = self._select_destinations( [ 1084.225967] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1084.225967] nova-conductor[53002]: selections = self._schedule( [ 1084.225967] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1084.225967] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 1084.225967] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1084.225967] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 1084.225967] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1084.225967] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1084.226631] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-8628a655-7974-4423-b6f4-73ec52291ffa tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] [instance: a892bb58-6df2-485f-ad91-ce4003739ea7] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager [None req-d9790ca0-d2d6-4d79-a136-e1ad9a91369f tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1086.079186] nova-conductor[53001]: Traceback (most recent call last): [ 1086.079186] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1086.079186] nova-conductor[53001]: return func(*args, **kwargs) [ 1086.079186] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1086.079186] nova-conductor[53001]: selections = self._select_destinations( [ 1086.079186] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1086.079186] nova-conductor[53001]: selections = self._schedule( [ 1086.079186] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1086.079186] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 1086.079186] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1086.079186] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 1086.079186] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager [ 1086.079186] nova-conductor[53001]: ERROR nova.conductor.manager [ 1086.086261] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d9790ca0-d2d6-4d79-a136-e1ad9a91369f tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1086.086493] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d9790ca0-d2d6-4d79-a136-e1ad9a91369f tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1086.086666] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d9790ca0-d2d6-4d79-a136-e1ad9a91369f tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1086.127818] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-d9790ca0-d2d6-4d79-a136-e1ad9a91369f tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] [instance: 2bd8c09a-a4c6-4d57-8918-2ba411f16a4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 1086.128574] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d9790ca0-d2d6-4d79-a136-e1ad9a91369f tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1086.128791] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d9790ca0-d2d6-4d79-a136-e1ad9a91369f tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1086.128962] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d9790ca0-d2d6-4d79-a136-e1ad9a91369f tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1086.139022] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-d9790ca0-d2d6-4d79-a136-e1ad9a91369f tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 1086.139022] nova-conductor[53001]: Traceback (most recent call last): [ 1086.139022] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1086.139022] nova-conductor[53001]: return func(*args, **kwargs) [ 1086.139022] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1086.139022] nova-conductor[53001]: selections = self._select_destinations( [ 1086.139022] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1086.139022] nova-conductor[53001]: selections = self._schedule( [ 1086.139022] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1086.139022] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 1086.139022] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1086.139022] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 1086.139022] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1086.139022] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1086.139022] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-d9790ca0-d2d6-4d79-a136-e1ad9a91369f tempest-ServersTestJSON-844148859 tempest-ServersTestJSON-844148859-project-member] [instance: 2bd8c09a-a4c6-4d57-8918-2ba411f16a4d] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager [None req-69adae2a-177f-43d0-8c6e-32a969f962f0 tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1086.695857] nova-conductor[53002]: Traceback (most recent call last): [ 1086.695857] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1086.695857] nova-conductor[53002]: return func(*args, **kwargs) [ 1086.695857] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1086.695857] nova-conductor[53002]: selections = self._select_destinations( [ 1086.695857] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1086.695857] nova-conductor[53002]: selections = self._schedule( [ 1086.695857] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1086.695857] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 1086.695857] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1086.695857] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 1086.695857] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager result = self.transport._send( [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager raise result [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager Traceback (most recent call last): [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._select_destinations( [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager selections = self._schedule( [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager [ 1086.695857] nova-conductor[53002]: ERROR nova.conductor.manager [ 1086.703015] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-69adae2a-177f-43d0-8c6e-32a969f962f0 tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1086.703306] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-69adae2a-177f-43d0-8c6e-32a969f962f0 tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1086.703534] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-69adae2a-177f-43d0-8c6e-32a969f962f0 tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1086.740025] nova-conductor[53002]: DEBUG nova.conductor.manager [None req-69adae2a-177f-43d0-8c6e-32a969f962f0 tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] [instance: ccbba05b-f097-4d60-8826-1108e86e5d53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53002) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 1086.740025] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-69adae2a-177f-43d0-8c6e-32a969f962f0 tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1086.740025] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-69adae2a-177f-43d0-8c6e-32a969f962f0 tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1086.740025] nova-conductor[53002]: DEBUG oslo_concurrency.lockutils [None req-69adae2a-177f-43d0-8c6e-32a969f962f0 tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53002) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1086.745061] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-69adae2a-177f-43d0-8c6e-32a969f962f0 tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 1086.745061] nova-conductor[53002]: Traceback (most recent call last): [ 1086.745061] nova-conductor[53002]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1086.745061] nova-conductor[53002]: return func(*args, **kwargs) [ 1086.745061] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1086.745061] nova-conductor[53002]: selections = self._select_destinations( [ 1086.745061] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1086.745061] nova-conductor[53002]: selections = self._schedule( [ 1086.745061] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1086.745061] nova-conductor[53002]: self._ensure_sufficient_hosts( [ 1086.745061] nova-conductor[53002]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1086.745061] nova-conductor[53002]: raise exception.NoValidHost(reason=reason) [ 1086.745061] nova-conductor[53002]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1086.745061] nova-conductor[53002]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1086.745603] nova-conductor[53002]: WARNING nova.scheduler.utils [None req-69adae2a-177f-43d0-8c6e-32a969f962f0 tempest-AttachInterfacesTestJSON-943622355 tempest-AttachInterfacesTestJSON-943622355-project-member] [instance: ccbba05b-f097-4d60-8826-1108e86e5d53] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager [None req-d16a9150-86ff-4b31-9488-61a9cb3485bb tempest-ServersTestJSON-1845120444 tempest-ServersTestJSON-1845120444-project-member] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1094.014584] nova-conductor[53001]: Traceback (most recent call last): [ 1094.014584] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1094.014584] nova-conductor[53001]: return func(*args, **kwargs) [ 1094.014584] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1094.014584] nova-conductor[53001]: selections = self._select_destinations( [ 1094.014584] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1094.014584] nova-conductor[53001]: selections = self._schedule( [ 1094.014584] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1094.014584] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 1094.014584] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1094.014584] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 1094.014584] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1654, in schedule_and_build_instances [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 942, in _schedule_instances [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/client.py", line 190, in call [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager result = self.transport._send( [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/transport.py", line 123, in _send [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager raise result [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager Traceback (most recent call last): [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager return func(*args, **kwargs) [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._select_destinations( [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager selections = self._schedule( [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager self._ensure_sufficient_hosts( [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager raise exception.NoValidHost(reason=reason) [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager [ 1094.014584] nova-conductor[53001]: ERROR nova.conductor.manager [ 1094.021638] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d16a9150-86ff-4b31-9488-61a9cb3485bb tempest-ServersTestJSON-1845120444 tempest-ServersTestJSON-1845120444-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1094.021866] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d16a9150-86ff-4b31-9488-61a9cb3485bb tempest-ServersTestJSON-1845120444 tempest-ServersTestJSON-1845120444-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1094.022068] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d16a9150-86ff-4b31-9488-61a9cb3485bb tempest-ServersTestJSON-1845120444 tempest-ServersTestJSON-1845120444-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1094.070390] nova-conductor[53001]: DEBUG nova.conductor.manager [None req-d16a9150-86ff-4b31-9488-61a9cb3485bb tempest-ServersTestJSON-1845120444 tempest-ServersTestJSON-1845120444-project-member] [instance: 9420412c-7a2b-4020-8725-f08a6bd5de16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5674e50f-0c0c-4f19-8379-104dac34660b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=53001) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1506}} [ 1094.071113] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d16a9150-86ff-4b31-9488-61a9cb3485bb tempest-ServersTestJSON-1845120444 tempest-ServersTestJSON-1845120444-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1094.071332] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d16a9150-86ff-4b31-9488-61a9cb3485bb tempest-ServersTestJSON-1845120444 tempest-ServersTestJSON-1845120444-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1094.071504] nova-conductor[53001]: DEBUG oslo_concurrency.lockutils [None req-d16a9150-86ff-4b31-9488-61a9cb3485bb tempest-ServersTestJSON-1845120444 tempest-ServersTestJSON-1845120444-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=53001) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1094.074210] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-d16a9150-86ff-4b31-9488-61a9cb3485bb tempest-ServersTestJSON-1845120444 tempest-ServersTestJSON-1845120444-project-member] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available. [ 1094.074210] nova-conductor[53001]: Traceback (most recent call last): [ 1094.074210] nova-conductor[53001]: File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner [ 1094.074210] nova-conductor[53001]: return func(*args, **kwargs) [ 1094.074210] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 224, in select_destinations [ 1094.074210] nova-conductor[53001]: selections = self._select_destinations( [ 1094.074210] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 251, in _select_destinations [ 1094.074210] nova-conductor[53001]: selections = self._schedule( [ 1094.074210] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 452, in _schedule [ 1094.074210] nova-conductor[53001]: self._ensure_sufficient_hosts( [ 1094.074210] nova-conductor[53001]: File "/opt/stack/nova/nova/scheduler/manager.py", line 499, in _ensure_sufficient_hosts [ 1094.074210] nova-conductor[53001]: raise exception.NoValidHost(reason=reason) [ 1094.074210] nova-conductor[53001]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. [ 1094.074210] nova-conductor[53001]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1094.074740] nova-conductor[53001]: WARNING nova.scheduler.utils [None req-d16a9150-86ff-4b31-9488-61a9cb3485bb tempest-ServersTestJSON-1845120444 tempest-ServersTestJSON-1845120444-project-member] [instance: 9420412c-7a2b-4020-8725-f08a6bd5de16] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available. [ 1112.718924] nova-conductor[53001]: DEBUG nova.db.main.api [None req-c07ba2b1-1566-4f59-a77f-855deef06699 tempest-ServerDiskConfigTestJSON-1556678235 tempest-ServerDiskConfigTestJSON-1556678235-project-member] Created instance_extra for ad98988d-92aa-4ace-8e40-cd316758002e {{(pid=53001) instance_extra_update_by_uuid /opt/stack/nova/nova/db/main/api.py:2551}}