[  579.161087] env[65419]: Service is starting with native threading. This is currently experimental. Do not use it in production without first testing it in pre-production.
[  579.809903] env[65478]: Service is starting with native threading. This is currently experimental. Do not use it in production without first testing it in pre-production.
[  581.365605] env[65478]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=65478) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
[  581.365877] env[65478]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=65478) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
[  581.365964] env[65478]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=65478) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
[  581.366262] env[65478]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
[  581.491980] env[65478]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=65478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:368}}
[  581.502596] env[65478]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.011s {{(pid=65478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:396}}
[  581.549084] env[65478]: INFO oslo_service.periodic_task [-] Skipping periodic task _heal_instance_info_cache because its interval is negative
[  582.232671] env[65478]: INFO nova.virt.driver [None req-96e70411-2827-4a2a-95ce-5c2c6d35a2ef None None] Loading compute driver 'vmwareapi.VMwareVCDriver'
[  582.307331] env[65478]: DEBUG oslo_concurrency.lockutils [None req-96e70411-2827-4a2a-95ce-5c2c6d35a2ef None None] Acquiring lock "oslo_vmware_api_lock" by "oslo_vmware.api.VMwareAPISession._create_session" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  582.307537] env[65478]: DEBUG oslo_concurrency.lockutils [None req-96e70411-2827-4a2a-95ce-5c2c6d35a2ef None None] Lock "oslo_vmware_api_lock" acquired by "oslo_vmware.api.VMwareAPISession._create_session" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  582.307648] env[65478]: DEBUG oslo_vmware.service [None req-96e70411-2827-4a2a-95ce-5c2c6d35a2ef None None] Creating suds client with soap_url='https://vc1.osci.c.eu-de-1.cloud.sap:443/sdk' and wsdl_url='https://vc1.osci.c.eu-de-1.cloud.sap:443/sdk/vimService.wsdl' {{(pid=65478) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:242}}
[  585.374909] env[65478]: DEBUG oslo_vmware.service [None req-96e70411-2827-4a2a-95ce-5c2c6d35a2ef None None] Invoking ServiceInstance.RetrieveServiceContent with opID=oslo.vmware-123af271-0190-4d61-9923-93e59949c659 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  585.390988] env[65478]: DEBUG oslo_vmware.api [None req-96e70411-2827-4a2a-95ce-5c2c6d35a2ef None None] Logging into host: vc1.osci.c.eu-de-1.cloud.sap. {{(pid=65478) _create_session /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:242}}
[  585.391212] env[65478]: DEBUG oslo_vmware.service [None req-96e70411-2827-4a2a-95ce-5c2c6d35a2ef None None] Invoking SessionManager.Login with opID=oslo.vmware-6896eccc-1c50-45f5-b00f-d0de6cc7e55e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  585.423960] env[65478]: INFO oslo_vmware.api [None req-96e70411-2827-4a2a-95ce-5c2c6d35a2ef None None] Successfully established new session; session ID is f9dd5.
[  585.424175] env[65478]: DEBUG oslo_concurrency.lockutils [None req-96e70411-2827-4a2a-95ce-5c2c6d35a2ef None None] Lock "oslo_vmware_api_lock" "released" by "oslo_vmware.api.VMwareAPISession._create_session" :: held 3.117s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  585.424701] env[65478]: INFO nova.virt.vmwareapi.driver [None req-96e70411-2827-4a2a-95ce-5c2c6d35a2ef None None] VMware vCenter version: 7.0.3
[  585.428433] env[65478]: DEBUG oslo_vmware.service [None req-96e70411-2827-4a2a-95ce-5c2c6d35a2ef None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-80d90e8c-d903-4313-a2d5-7045358d5847 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  585.446124] env[65478]: DEBUG oslo_vmware.service [None req-96e70411-2827-4a2a-95ce-5c2c6d35a2ef None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4005e74e-af5e-4129-94ab-96d148538e3e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  585.452412] env[65478]: DEBUG oslo_vmware.service [None req-96e70411-2827-4a2a-95ce-5c2c6d35a2ef None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0b00ae9f-9761-4ca1-9df9-81500abd2c63 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  585.459183] env[65478]: DEBUG oslo_vmware.service [None req-96e70411-2827-4a2a-95ce-5c2c6d35a2ef None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-fade07d8-8757-47a6-b515-12ae7a2a6dfb {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  585.473545] env[65478]: DEBUG oslo_vmware.service [None req-96e70411-2827-4a2a-95ce-5c2c6d35a2ef None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6d7e041d-db71-4a13-87e8-f637c28dd6f8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  585.479532] env[65478]: DEBUG oslo_vmware.service [None req-96e70411-2827-4a2a-95ce-5c2c6d35a2ef None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-eb85e782-bbd6-4e87-af3b-7fe4a5189fd0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  585.509984] env[65478]: DEBUG oslo_vmware.service [None req-96e70411-2827-4a2a-95ce-5c2c6d35a2ef None None] Invoking ExtensionManager.FindExtension with opID=oslo.vmware-33b8282b-afe8-46a6-9602-8ba3d2922f47 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  585.514895] env[65478]: DEBUG nova.virt.vmwareapi.driver [None req-96e70411-2827-4a2a-95ce-5c2c6d35a2ef None None] Extension org.openstack.compute already exists. {{(pid=65478) _register_openstack_extension /opt/stack/nova/nova/virt/vmwareapi/driver.py:230}}
[  585.517560] env[65478]: INFO nova.compute.provider_config [None req-96e70411-2827-4a2a-95ce-5c2c6d35a2ef None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
[  586.020599] env[65478]: DEBUG nova.context [None req-96e70411-2827-4a2a-95ce-5c2c6d35a2ef None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),98716bee-a046-4096-90da-4ae47c5fe23e(cell1) {{(pid=65478) load_cells /opt/stack/nova/nova/context.py:509}}
[  586.021157] env[65478]: INFO nova.utils [None req-96e70411-2827-4a2a-95ce-5c2c6d35a2ef None None] The cell worker thread pool MainProcess.cell_worker is initialized
[  586.023035] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  586.023214] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  586.023906] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  586.024630] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Acquiring lock "98716bee-a046-4096-90da-4ae47c5fe23e" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  586.027177] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Lock "98716bee-a046-4096-90da-4ae47c5fe23e" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  586.028319] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Lock "98716bee-a046-4096-90da-4ae47c5fe23e" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  586.078222] env[65478]: INFO dbcounter [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Registered counter for database nova_cell1
[  586.078842] env[65478]: INFO dbcounter [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Registered counter for database nova_cell0
[  586.089863] env[65478]: DEBUG oslo_db.sqlalchemy.engines [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=65478) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
[  586.090228] env[65478]: DEBUG oslo_db.sqlalchemy.engines [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=65478) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
[  586.097479] env[65478]: ERROR nova.db.main.api [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] No DB access allowed in nova-compute:   File "/usr/lib/python3.10/threading.py", line 973, in _bootstrap
[  586.097479] env[65478]:     self._bootstrap_inner()
[  586.097479] env[65478]:   File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner
[  586.097479] env[65478]:     self.run()
[  586.097479] env[65478]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/futurist/_thread.py", line 104, in run
[  586.097479] env[65478]:     work.run()
[  586.097479] env[65478]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py", line 45, in run
[  586.097479] env[65478]:     result = self.fn(*self.args, **self.kwargs)
[  586.097479] env[65478]:   File "/opt/stack/nova/nova/utils.py", line 632, in context_wrapper
[  586.097479] env[65478]:     return func(*args, **kwargs)
[  586.097479] env[65478]:   File "/opt/stack/nova/nova/context.py", line 457, in gather_result
[  586.097479] env[65478]:     result = fn(*args, **kwargs)
[  586.097479] env[65478]:   File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper
[  586.097479] env[65478]:     return f(*args, **kwargs)
[  586.097479] env[65478]:   File "/opt/stack/nova/nova/objects/service.py", line 574, in _db_service_get_minimum_version
[  586.097479] env[65478]:     return db.service_get_minimum_version(context, binaries)
[  586.097479] env[65478]:   File "/opt/stack/nova/nova/db/main/api.py", line 238, in wrapper
[  586.097479] env[65478]:     _check_db_access()
[  586.097479] env[65478]:   File "/opt/stack/nova/nova/db/main/api.py", line 188, in _check_db_access
[  586.097479] env[65478]:     stacktrace = ''.join(traceback.format_stack())
[  586.097479] env[65478]: 
[  586.098218] env[65478]: ERROR nova.db.main.api [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] No DB access allowed in nova-compute:   File "/usr/lib/python3.10/threading.py", line 973, in _bootstrap
[  586.098218] env[65478]:     self._bootstrap_inner()
[  586.098218] env[65478]:   File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner
[  586.098218] env[65478]:     self.run()
[  586.098218] env[65478]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/futurist/_thread.py", line 104, in run
[  586.098218] env[65478]:     work.run()
[  586.098218] env[65478]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py", line 45, in run
[  586.098218] env[65478]:     result = self.fn(*self.args, **self.kwargs)
[  586.098218] env[65478]:   File "/opt/stack/nova/nova/utils.py", line 632, in context_wrapper
[  586.098218] env[65478]:     return func(*args, **kwargs)
[  586.098218] env[65478]:   File "/opt/stack/nova/nova/context.py", line 457, in gather_result
[  586.098218] env[65478]:     result = fn(*args, **kwargs)
[  586.098218] env[65478]:   File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper
[  586.098218] env[65478]:     return f(*args, **kwargs)
[  586.098218] env[65478]:   File "/opt/stack/nova/nova/objects/service.py", line 574, in _db_service_get_minimum_version
[  586.098218] env[65478]:     return db.service_get_minimum_version(context, binaries)
[  586.098218] env[65478]:   File "/opt/stack/nova/nova/db/main/api.py", line 238, in wrapper
[  586.098218] env[65478]:     _check_db_access()
[  586.098218] env[65478]:   File "/opt/stack/nova/nova/db/main/api.py", line 188, in _check_db_access
[  586.098218] env[65478]:     stacktrace = ''.join(traceback.format_stack())
[  586.098218] env[65478]: 
[  586.099023] env[65478]: WARNING nova.objects.service [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Failed to get minimum service version for cell 00000000-0000-0000-0000-000000000000
[  586.099023] env[65478]: WARNING nova.objects.service [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Failed to get minimum service version for cell 98716bee-a046-4096-90da-4ae47c5fe23e
[  586.099023] env[65478]: WARNING oslo_service.backend._threading.service [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] no_fork=True: running service in main process
[  586.099272] env[65478]: INFO nova.service [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Starting compute node (version 32.1.0)
[  586.604397] env[65478]: WARNING nova.virt.vmwareapi.driver [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] The vmwareapi driver is not tested by the OpenStack project nor does it have clear maintainer(s) and thus its quality can not be ensured. It should be considered experimental and may be removed in a future release. If you are using the driver in production please let us know via the openstack-discuss mailing list.
[  586.605623] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Getting list of instances from cluster (obj){
[  586.605623] env[65478]:    value = "domain-c8"
[  586.605623] env[65478]:    _type = "ClusterComputeResource"
[  586.605623] env[65478]:  } {{(pid=65478) list_instances /opt/stack/nova/nova/virt/vmwareapi/vmops.py:2116}}
[  586.607446] env[65478]: DEBUG oslo_vmware.service [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-360c41f5-46d5-4f4d-8454-e534a86463ca {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  586.620494] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Got total of 0 instances {{(pid=65478) list_instances /opt/stack/nova/nova/virt/vmwareapi/vmops.py:2125}}
[  586.620994] env[65478]: INFO nova.virt.node [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Generated node identity e3a5020e-0218-494b-ae38-8b55aa77f6f5
[  586.621562] env[65478]: INFO nova.virt.node [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Wrote node identity e3a5020e-0218-494b-ae38-8b55aa77f6f5 to /opt/stack/data/n-cpu-1/compute_id
[  587.124072] env[65478]: WARNING nova.compute.manager [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Compute nodes ['e3a5020e-0218-494b-ae38-8b55aa77f6f5'] for host cpu-1 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
[  588.129115] env[65478]: INFO nova.compute.manager [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
[  589.134352] env[65478]: WARNING nova.compute.manager [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] No compute node record found for host cpu-1. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host cpu-1 could not be found.
[  589.134732] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  589.134732] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  589.134875] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  589.134976] env[65478]: DEBUG nova.compute.resource_tracker [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[  589.135929] env[65478]: DEBUG oslo_vmware.service [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6a8553fd-e29b-4831-a546-4bd976404b5d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  589.144937] env[65478]: DEBUG oslo_vmware.service [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4d1bebdc-1443-419a-a653-7f4f9fe5fd90 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  589.160493] env[65478]: DEBUG oslo_vmware.service [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-53f522f1-93c5-4072-a045-f349d190be0f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  589.167498] env[65478]: DEBUG oslo_vmware.service [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-5d6f21c6-ad17-468a-8a46-3c9d500990b6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  589.198168] env[65478]: DEBUG nova.compute.resource_tracker [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=181966MB free_disk=95GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[  589.198312] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  589.198453] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  589.700829] env[65478]: WARNING nova.compute.resource_tracker [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] No compute node record for cpu-1:e3a5020e-0218-494b-ae38-8b55aa77f6f5: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host e3a5020e-0218-494b-ae38-8b55aa77f6f5 could not be found.
[  590.204416] env[65478]: INFO nova.compute.resource_tracker [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Compute node record created for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 with uuid: e3a5020e-0218-494b-ae38-8b55aa77f6f5
[  591.713027] env[65478]: DEBUG nova.compute.resource_tracker [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Total usable vcpus: 48, total allocated vcpus: 0 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[  591.713027] env[65478]: DEBUG nova.compute.resource_tracker [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=512MB phys_disk=100GB used_disk=0GB total_vcpus=48 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[  591.900587] env[65478]: INFO nova.scheduler.client.report [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] [req-aa6343fd-8d2e-4179-abc6-41aacec19e51] Created resource provider record via placement API for resource provider with UUID e3a5020e-0218-494b-ae38-8b55aa77f6f5 and name domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28.
[  591.919627] env[65478]: DEBUG oslo_vmware.service [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a577a91d-5661-4ba2-9cfb-eaba8016078c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  591.929233] env[65478]: DEBUG oslo_vmware.service [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c08c021c-1d32-476c-ab82-7f44df56e168 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  591.977090] env[65478]: DEBUG oslo_vmware.service [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-adba7b07-7064-4805-9e8a-fdea847a49c7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  591.984690] env[65478]: DEBUG oslo_vmware.service [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-5444709b-2b0f-4488-be3e-f018fa98c728 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  591.997675] env[65478]: DEBUG nova.compute.provider_tree [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  592.537338] env[65478]: DEBUG nova.scheduler.client.report [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Updated inventory for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with generation 0 in Placement from set_inventory_for_provider using data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}}
[  592.537556] env[65478]: DEBUG nova.compute.provider_tree [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Updating resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 generation from 0 to 1 during operation: update_inventory {{(pid=65478) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
[  592.537686] env[65478]: DEBUG nova.compute.provider_tree [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  592.586449] env[65478]: DEBUG nova.compute.provider_tree [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Updating resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 generation from 1 to 2 during operation: update_traits {{(pid=65478) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
[  593.091131] env[65478]: DEBUG nova.compute.resource_tracker [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[  593.091519] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.893s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  593.091519] env[65478]: DEBUG nova.service [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Creating RPC server for service compute {{(pid=65478) start /opt/stack/nova/nova/service.py:177}}
[  593.105335] env[65478]: DEBUG nova.service [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] Join ServiceGroup membership for this service compute {{(pid=65478) start /opt/stack/nova/nova/service.py:194}}
[  593.105582] env[65478]: DEBUG nova.servicegroup.drivers.db [None req-ef32bf74-4d46-42bd-a5c6-ef0761bf410a None None] DB_Driver: join new ServiceGroup member cpu-1 to the compute group, service = <Service: host=cpu-1, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=65478) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
[  598.609657] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[  642.107261] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  642.107670] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  642.107670] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  642.107834] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  642.107939] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  642.108093] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  642.108257] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._sync_power_states {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  642.611176] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Getting list of instances from cluster (obj){
[  642.611176] env[65478]:    value = "domain-c8"
[  642.611176] env[65478]:    _type = "ClusterComputeResource"
[  642.611176] env[65478]:  } {{(pid=65478) list_instances /opt/stack/nova/nova/virt/vmwareapi/vmops.py:2116}}
[  642.612591] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-660247e2-60fe-45d2-8cdd-bbcc5f885321 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  642.621614] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Got total of 0 instances {{(pid=65478) list_instances /opt/stack/nova/nova/virt/vmwareapi/vmops.py:2125}}
[  642.621823] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  642.621968] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[  642.622133] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  643.125078] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  643.125474] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  643.125474] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  643.125644] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[  643.126501] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c15b5ff2-0831-4551-8163-1c26a32c094e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  643.134652] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0a8b38e7-6648-4eab-ad66-888403bfc9ec {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  643.148919] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4a104956-530c-4d55-b221-41c89a537a29 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  643.155917] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-432d93e9-3dbf-4b12-928e-54648414df84 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  643.185228] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=181988MB free_disk=95GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[  643.185407] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  643.185556] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  644.203873] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 0 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[  644.204145] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=512MB phys_disk=100GB used_disk=0GB total_vcpus=48 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[  644.218639] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e7fe0a1f-b615-4ac4-9cea-b0777e9c24f5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  644.225804] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-7384b9e7-1c7c-4894-9989-8bddb846a9ba {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  644.257516] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-88307363-9e9f-47ff-a906-002efd480b0c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  644.264766] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-cf3bd59d-7307-4853-91af-c6d4df677621 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  644.278227] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  644.781588] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  645.286377] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[  645.286780] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.101s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  645.286780] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  645.287057] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Getting list of instances from cluster (obj){
[  645.287057] env[65478]:    value = "domain-c8"
[  645.287057] env[65478]:    _type = "ClusterComputeResource"
[  645.287057] env[65478]:  } {{(pid=65478) list_instances /opt/stack/nova/nova/virt/vmwareapi/vmops.py:2116}}
[  645.288142] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a1ce6ee0-74fe-4219-b6fe-c3b224ded7cd {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  645.296990] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Got total of 0 instances {{(pid=65478) list_instances /opt/stack/nova/nova/virt/vmwareapi/vmops.py:2125}}
[  645.297377] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 59.44 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[  701.169565] env[65478]: INFO nova.utils [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] The default thread pool MainProcess.default is initialized
[  701.171209] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Acquiring lock "79200ab1-07f5-48a8-b2f0-b670852df5a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  701.171771] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Lock "79200ab1-07f5-48a8-b2f0-b670852df5a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  701.180403] env[65478]: DEBUG oslo_concurrency.lockutils [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Acquiring lock "caf7856c-4e51-4e6c-ad32-2088e15d5d8f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  701.180403] env[65478]: DEBUG oslo_concurrency.lockutils [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Lock "caf7856c-4e51-4e6c-ad32-2088e15d5d8f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  701.679565] env[65478]: DEBUG nova.compute.manager [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  701.683518] env[65478]: DEBUG nova.compute.manager [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  702.236743] env[65478]: DEBUG oslo_concurrency.lockutils [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  702.238705] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  702.239035] env[65478]: DEBUG oslo_concurrency.lockutils [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  702.241031] env[65478]: INFO nova.compute.claims [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  703.231148] env[65478]: DEBUG oslo_concurrency.lockutils [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Acquiring lock "f19f4a44-cae7-4ce1-ae57-a6155c93ed54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  703.231658] env[65478]: DEBUG oslo_concurrency.lockutils [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Lock "f19f4a44-cae7-4ce1-ae57-a6155c93ed54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  703.361924] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e3ba16c5-6283-455f-8b58-3f98301277ef {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  703.372040] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a3b7ea7a-5a00-4971-a7fa-e6241befce19 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  703.408084] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-fe525129-e729-4e70-ad4b-e4f623c69e81 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  703.415868] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0f94b6a6-4f4c-485a-a83f-ae809e2031fe {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  703.430072] env[65478]: DEBUG nova.compute.provider_tree [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  703.629689] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Acquiring lock "7507f1f3-c896-492c-9e9b-ebbd47b7c629" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  703.630452] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Lock "7507f1f3-c896-492c-9e9b-ebbd47b7c629" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  703.734510] env[65478]: DEBUG nova.compute.manager [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  703.933650] env[65478]: DEBUG nova.scheduler.client.report [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  704.132644] env[65478]: DEBUG nova.compute.manager [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  704.276155] env[65478]: DEBUG oslo_concurrency.lockutils [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  704.437801] env[65478]: DEBUG oslo_concurrency.lockutils [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.199s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  704.438558] env[65478]: DEBUG nova.compute.manager [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  704.441637] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.201s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  704.444236] env[65478]: INFO nova.compute.claims [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  704.659985] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  704.734032] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  704.734282] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  704.951758] env[65478]: DEBUG nova.compute.utils [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  704.955846] env[65478]: DEBUG nova.compute.manager [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  704.956227] env[65478]: DEBUG nova.network.neutron [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  704.957101] env[65478]: WARNING neutronclient.v2_0.client [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  704.958815] env[65478]: WARNING neutronclient.v2_0.client [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  705.142537] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Acquiring lock "230cc05f-433e-4510-947f-35466335662d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  705.144355] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Lock "230cc05f-433e-4510-947f-35466335662d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  705.239822] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  705.240060] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  705.240240] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  705.240392] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  705.240536] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  705.240681] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  705.240874] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[  705.241034] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  705.463631] env[65478]: DEBUG nova.compute.manager [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  705.560871] env[65478]: DEBUG oslo_vmware.service [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-19359580-fab4-413d-b95d-31eb6deaa73e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  705.569643] env[65478]: DEBUG oslo_vmware.service [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3793cd07-444a-4e0a-b477-62e8d5865f61 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  705.602949] env[65478]: DEBUG oslo_vmware.service [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d7ebac86-8666-42b1-9c4b-a2b4065339a3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  705.610955] env[65478]: DEBUG oslo_vmware.service [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0f28216c-b8b1-41de-902d-b3b7ac80f95f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  705.626311] env[65478]: DEBUG nova.compute.provider_tree [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  705.646362] env[65478]: DEBUG nova.compute.manager [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  705.743296] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  705.910187] env[65478]: DEBUG nova.policy [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6478afb0c13c4cc38812b6cb1ffc550b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd8c4cd35c44466b1991950f28d886b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  706.129909] env[65478]: DEBUG nova.scheduler.client.report [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  706.170472] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  706.477650] env[65478]: DEBUG nova.compute.manager [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  706.508194] env[65478]: DEBUG nova.virt.hardware [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  706.508194] env[65478]: DEBUG nova.virt.hardware [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  706.508194] env[65478]: DEBUG nova.virt.hardware [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  706.508359] env[65478]: DEBUG nova.virt.hardware [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  706.508359] env[65478]: DEBUG nova.virt.hardware [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  706.508359] env[65478]: DEBUG nova.virt.hardware [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  706.508359] env[65478]: DEBUG nova.virt.hardware [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  706.508359] env[65478]: DEBUG nova.virt.hardware [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  706.509309] env[65478]: DEBUG nova.virt.hardware [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  706.509592] env[65478]: DEBUG nova.virt.hardware [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  706.509824] env[65478]: DEBUG nova.virt.hardware [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  706.511090] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-41d410f5-86ae-47d2-a8b7-ebc650c80bb7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  706.519461] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-922403b9-40c7-4d6a-adcc-7bedd4c65e0a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  706.538058] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c60e2565-fe87-4459-a9df-502e7571cb60 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  706.557020] env[65478]: DEBUG nova.network.neutron [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Successfully created port: 457c1734-c99a-4d71-a200-0341a9e3bdd8 {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  706.563526] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Acquiring lock "06b7de0a-c338-44b8-97e7-c80281067528" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  706.563526] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Lock "06b7de0a-c338-44b8-97e7-c80281067528" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  706.633673] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.195s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  706.634342] env[65478]: DEBUG nova.compute.manager [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  706.639894] env[65478]: DEBUG oslo_concurrency.lockutils [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.360s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  706.639894] env[65478]: INFO nova.compute.claims [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  707.065634] env[65478]: DEBUG nova.compute.manager [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  707.150665] env[65478]: DEBUG nova.compute.utils [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  707.152455] env[65478]: DEBUG nova.compute.manager [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  707.152455] env[65478]: DEBUG nova.network.neutron [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  707.152736] env[65478]: WARNING neutronclient.v2_0.client [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  707.153035] env[65478]: WARNING neutronclient.v2_0.client [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  707.509492] env[65478]: DEBUG nova.policy [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2dcc1c86d1f14ece891974bfd4345ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc5e9cd81b34137a673792a172ebf17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  707.591485] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  707.658425] env[65478]: DEBUG nova.compute.manager [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  707.774988] env[65478]: DEBUG oslo_vmware.service [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-32ed1b87-4b0f-4074-8e70-c4d6d5354a29 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  707.785027] env[65478]: DEBUG oslo_vmware.service [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-62c8f6f1-5b7f-45d5-a123-1209c9e20d4a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  707.817774] env[65478]: DEBUG oslo_vmware.service [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-767a08bf-3da8-4e20-a7dc-e285ec8215b1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  707.826749] env[65478]: DEBUG oslo_vmware.service [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f0c2317a-fc70-4b4a-a86d-2c99bf03f64d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  707.842157] env[65478]: DEBUG nova.compute.provider_tree [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  707.930422] env[65478]: DEBUG nova.network.neutron [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Successfully created port: c7a2377a-6ee6-4723-9536-d02ae3418549 {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  708.340374] env[65478]: DEBUG nova.network.neutron [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Successfully updated port: 457c1734-c99a-4d71-a200-0341a9e3bdd8 {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  708.347925] env[65478]: DEBUG nova.scheduler.client.report [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  708.671690] env[65478]: DEBUG nova.compute.manager [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  708.705496] env[65478]: DEBUG nova.virt.hardware [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  708.705685] env[65478]: DEBUG nova.virt.hardware [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  708.705797] env[65478]: DEBUG nova.virt.hardware [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  708.706109] env[65478]: DEBUG nova.virt.hardware [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  708.706178] env[65478]: DEBUG nova.virt.hardware [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  708.706364] env[65478]: DEBUG nova.virt.hardware [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  708.706813] env[65478]: DEBUG nova.virt.hardware [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  708.707034] env[65478]: DEBUG nova.virt.hardware [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  708.707681] env[65478]: DEBUG nova.virt.hardware [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  708.707681] env[65478]: DEBUG nova.virt.hardware [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  708.707681] env[65478]: DEBUG nova.virt.hardware [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  708.708481] env[65478]: DEBUG oslo_vmware.service [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-73152b2c-7a9d-4b5a-a4ad-b9c18eb6d528 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  708.716611] env[65478]: DEBUG oslo_vmware.service [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-bb9e6289-5646-4130-b9e3-1127ae4afe79 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  708.844028] env[65478]: DEBUG oslo_concurrency.lockutils [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Acquiring lock "refresh_cache-caf7856c-4e51-4e6c-ad32-2088e15d5d8f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  708.844028] env[65478]: DEBUG oslo_concurrency.lockutils [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Acquired lock "refresh_cache-caf7856c-4e51-4e6c-ad32-2088e15d5d8f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  708.844028] env[65478]: DEBUG nova.network.neutron [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  708.855808] env[65478]: DEBUG oslo_concurrency.lockutils [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.221s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  708.858213] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.196s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  708.858457] env[65478]: DEBUG nova.compute.manager [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  708.862136] env[65478]: INFO nova.compute.claims [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  709.372529] env[65478]: DEBUG nova.compute.utils [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  709.373513] env[65478]: DEBUG nova.compute.manager [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  709.373856] env[65478]: DEBUG nova.network.neutron [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  709.374470] env[65478]: WARNING neutronclient.v2_0.client [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  709.374825] env[65478]: WARNING neutronclient.v2_0.client [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  709.590486] env[65478]: DEBUG nova.network.neutron [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  709.632898] env[65478]: DEBUG nova.network.neutron [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Successfully updated port: c7a2377a-6ee6-4723-9536-d02ae3418549 {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  709.820416] env[65478]: DEBUG nova.policy [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '847ee6ca393a41cd8c565ecf3d1b96a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c94cfe27654d26bf3daa7e643aaffa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  709.879118] env[65478]: DEBUG nova.compute.manager [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  709.898629] env[65478]: WARNING neutronclient.v2_0.client [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  710.019807] env[65478]: DEBUG oslo_vmware.service [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b62d95ad-86f7-4536-887e-e647dff87cc5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  710.031412] env[65478]: DEBUG oslo_vmware.service [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ca3548bf-cffd-4e27-b334-b18817f90575 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  710.067423] env[65478]: DEBUG oslo_vmware.service [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-66d46f6b-6f68-4f9d-b755-2a1e0e3fdc7d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  710.076807] env[65478]: DEBUG oslo_vmware.service [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-5d497776-0488-47c7-9a71-d1a35c649e26 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  710.100185] env[65478]: DEBUG nova.compute.provider_tree [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  710.134983] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Acquiring lock "refresh_cache-79200ab1-07f5-48a8-b2f0-b670852df5a0" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  710.134983] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Acquired lock "refresh_cache-79200ab1-07f5-48a8-b2f0-b670852df5a0" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  710.134983] env[65478]: DEBUG nova.network.neutron [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  710.356441] env[65478]: DEBUG nova.network.neutron [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Successfully created port: 5850a379-6213-4351-8b9c-5677d834c517 {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  710.549735] env[65478]: DEBUG nova.network.neutron [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Updating instance_info_cache with network_info: [{"id": "457c1734-c99a-4d71-a200-0341a9e3bdd8", "address": "fa:16:3e:90:77:31", "network": {"id": "eab0e877-79ef-45b8-a26f-7dd517a13b53", "bridge": "br-int", "label": "tempest-FloatingIPsAssociationTestJSON-364284774-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "7dd8c4cd35c44466b1991950f28d886b", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "054fcd1e-638e-425a-a1de-78cb188ae026", "external-id": "nsx-vlan-transportzone-658", "segmentation_id": 658, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap457c1734-c9", "ovs_interfaceid": "457c1734-c99a-4d71-a200-0341a9e3bdd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  710.604382] env[65478]: DEBUG nova.scheduler.client.report [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  710.699608] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Acquiring lock "78246782-d2a2-4819-8924-51764ffe05aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  710.699804] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Lock "78246782-d2a2-4819-8924-51764ffe05aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  710.867450] env[65478]: DEBUG nova.network.neutron [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  710.890866] env[65478]: DEBUG nova.compute.manager [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  710.920964] env[65478]: DEBUG nova.virt.hardware [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  710.921171] env[65478]: DEBUG nova.virt.hardware [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  710.921285] env[65478]: DEBUG nova.virt.hardware [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  710.921420] env[65478]: DEBUG nova.virt.hardware [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  710.921526] env[65478]: DEBUG nova.virt.hardware [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  710.921632] env[65478]: DEBUG nova.virt.hardware [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  710.921799] env[65478]: DEBUG nova.virt.hardware [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  710.921917] env[65478]: DEBUG nova.virt.hardware [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  710.922054] env[65478]: DEBUG nova.virt.hardware [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  710.922177] env[65478]: DEBUG nova.virt.hardware [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  710.922306] env[65478]: DEBUG nova.virt.hardware [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  710.923294] env[65478]: DEBUG oslo_vmware.service [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6d17b49a-2cd2-4809-b2e4-877dd633755d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  710.930878] env[65478]: DEBUG oslo_vmware.service [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c7c2bb91-bf65-4ed8-8e41-9b4d6c4a1b87 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  711.052773] env[65478]: DEBUG oslo_concurrency.lockutils [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Releasing lock "refresh_cache-caf7856c-4e51-4e6c-ad32-2088e15d5d8f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  711.053101] env[65478]: DEBUG nova.compute.manager [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Instance network_info: |[{"id": "457c1734-c99a-4d71-a200-0341a9e3bdd8", "address": "fa:16:3e:90:77:31", "network": {"id": "eab0e877-79ef-45b8-a26f-7dd517a13b53", "bridge": "br-int", "label": "tempest-FloatingIPsAssociationTestJSON-364284774-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "7dd8c4cd35c44466b1991950f28d886b", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "054fcd1e-638e-425a-a1de-78cb188ae026", "external-id": "nsx-vlan-transportzone-658", "segmentation_id": 658, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap457c1734-c9", "ovs_interfaceid": "457c1734-c99a-4d71-a200-0341a9e3bdd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  711.053670] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:90:77:31', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': '054fcd1e-638e-425a-a1de-78cb188ae026', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': '457c1734-c99a-4d71-a200-0341a9e3bdd8', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  711.067435] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Creating folder: OpenStack. Parent ref: group-v4. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  711.067742] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-87f1fa42-10fe-426b-97d1-fee3af8d659a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  711.080913] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Created folder: OpenStack in parent group-v4.
[  711.081180] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Creating folder: Project (7dd8c4cd35c44466b1991950f28d886b). Parent ref: group-v1161186. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  711.081551] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-adfe0641-0c6c-4136-8507-0256054df3d1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  711.090373] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Created folder: Project (7dd8c4cd35c44466b1991950f28d886b) in parent group-v1161186.
[  711.090571] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Creating folder: Instances. Parent ref: group-v1161187. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  711.090834] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-94b6c2cd-1d24-41c3-b36f-f68a844a2bb8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  711.098015] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Created folder: Instances in parent group-v1161187.
[  711.098631] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  711.098946] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  711.099392] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-d7ef3705-63ca-4a48-9c2d-a37633d03804 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  711.114328] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.258s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  711.115133] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 5.372s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  711.115397] env[65478]: DEBUG nova.compute.manager [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  711.118038] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  711.122657] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.945s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  711.124757] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  711.124757] env[65478]:    value = "task-6011429"
[  711.124757] env[65478]:    _type = "Task"
[  711.124757] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  711.128438] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[  711.129422] env[65478]: INFO nova.compute.claims [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  711.132646] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c055f90a-3188-4dbb-8ae1-ce40daca1b7e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  711.143957] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011429, 'name': CreateVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  711.161221] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d43af339-d1e8-4522-afab-33774983bb56 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  711.181113] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3b456615-23d2-4aac-b77e-671806c9fcac {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  711.187942] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-fed74823-0b33-496a-ae51-a290dbcbf306 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  711.770096] env[65478]: DEBUG nova.compute.manager [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  711.812522] env[65478]: DEBUG nova.compute.utils [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  711.824091] env[65478]: DEBUG nova.compute.manager [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  711.826711] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011429, 'name': CreateVM_Task, 'duration_secs': 0.395936} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  711.827045] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=181986MB free_disk=95GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[  711.827552] env[65478]: DEBUG nova.network.neutron [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  711.827907] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  711.828187] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  711.828668] env[65478]: WARNING neutronclient.v2_0.client [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  711.829418] env[65478]: WARNING neutronclient.v2_0.client [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  711.831049] env[65478]: WARNING neutronclient.v2_0.client [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  712.140030] env[65478]: DEBUG nova.network.neutron [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Successfully updated port: 5850a379-6213-4351-8b9c-5677d834c517 {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  712.246821] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6134de4d-83d3-4fd1-82cf-924793c404a5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  712.255797] env[65478]: DEBUG oslo_concurrency.lockutils [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  712.256160] env[65478]: DEBUG oslo_concurrency.lockutils [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  712.256777] env[65478]: DEBUG oslo_concurrency.lockutils [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Acquired external semaphore "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  712.257091] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-f6f4a179-bb4c-4cf3-b4f7-c538e3af49d7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  712.261373] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for the task: (returnval){
[  712.261373] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]5233a5dd-78fa-7f38-2828-6b759612ee5c"
[  712.261373] env[65478]:    _type = "Task"
[  712.261373] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  712.271748] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5233a5dd-78fa-7f38-2828-6b759612ee5c, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  712.321817] env[65478]: DEBUG nova.compute.manager [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  712.333115] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  712.431674] env[65478]: DEBUG oslo_vmware.service [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-79c45b31-5489-4ace-a7a1-93cb8aae948b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  712.440401] env[65478]: DEBUG oslo_vmware.service [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d5c53db3-6571-424a-9d13-6bf07ab3fac6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  712.477851] env[65478]: DEBUG oslo_vmware.service [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-393bf8ef-cad2-4ad3-9b0e-3502e42293da {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  712.485850] env[65478]: DEBUG oslo_vmware.service [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-5113e624-406a-46c9-a8b0-4186a6ae58a0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  712.499225] env[65478]: DEBUG nova.compute.provider_tree [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  712.612939] env[65478]: DEBUG nova.compute.manager [req-bb6729b0-7e90-4778-85de-2d6c8454f6b0 req-2de02ef9-aa8a-45e9-971d-57bb370658fe service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Received event network-vif-plugged-457c1734-c99a-4d71-a200-0341a9e3bdd8 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  712.614400] env[65478]: DEBUG oslo_concurrency.lockutils [req-bb6729b0-7e90-4778-85de-2d6c8454f6b0 req-2de02ef9-aa8a-45e9-971d-57bb370658fe service nova] Acquiring lock "caf7856c-4e51-4e6c-ad32-2088e15d5d8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  712.614578] env[65478]: DEBUG oslo_concurrency.lockutils [req-bb6729b0-7e90-4778-85de-2d6c8454f6b0 req-2de02ef9-aa8a-45e9-971d-57bb370658fe service nova] Lock "caf7856c-4e51-4e6c-ad32-2088e15d5d8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  712.614715] env[65478]: DEBUG oslo_concurrency.lockutils [req-bb6729b0-7e90-4778-85de-2d6c8454f6b0 req-2de02ef9-aa8a-45e9-971d-57bb370658fe service nova] Lock "caf7856c-4e51-4e6c-ad32-2088e15d5d8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  712.614850] env[65478]: DEBUG nova.compute.manager [req-bb6729b0-7e90-4778-85de-2d6c8454f6b0 req-2de02ef9-aa8a-45e9-971d-57bb370658fe service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] No waiting events found dispatching network-vif-plugged-457c1734-c99a-4d71-a200-0341a9e3bdd8 {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  712.614994] env[65478]: WARNING nova.compute.manager [req-bb6729b0-7e90-4778-85de-2d6c8454f6b0 req-2de02ef9-aa8a-45e9-971d-57bb370658fe service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Received unexpected event network-vif-plugged-457c1734-c99a-4d71-a200-0341a9e3bdd8 for instance with vm_state building and task_state spawning.
[  712.642616] env[65478]: DEBUG oslo_concurrency.lockutils [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Acquiring lock "refresh_cache-f19f4a44-cae7-4ce1-ae57-a6155c93ed54" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  712.642774] env[65478]: DEBUG oslo_concurrency.lockutils [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Acquired lock "refresh_cache-f19f4a44-cae7-4ce1-ae57-a6155c93ed54" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  712.642886] env[65478]: DEBUG nova.network.neutron [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  712.771821] env[65478]: DEBUG oslo_concurrency.lockutils [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  712.771821] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  712.772079] env[65478]: DEBUG oslo_concurrency.lockutils [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  712.772437] env[65478]: DEBUG oslo_concurrency.lockutils [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  712.772594] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Creating directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  712.772807] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-1855e7ac-bb9f-4764-9a02-8628f8cf712c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  712.792879] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Created directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  712.793123] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Folder [datastore1] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  712.794020] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-420fdf3a-902f-40bc-add5-60e3d7c79a43 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  712.801460] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-01c56494-b5fc-43d5-9f71-ff3c032712a8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  712.807650] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for the task: (returnval){
[  712.807650] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52b434ad-04f5-479e-250c-55a16d8ec07a"
[  712.807650] env[65478]:    _type = "Task"
[  712.807650] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  712.816584] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52b434ad-04f5-479e-250c-55a16d8ec07a, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  712.916994] env[65478]: DEBUG nova.policy [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6679585815554a6fae59bef8a3719435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37881a9fe4b44e59ade851fbf1800f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  713.002223] env[65478]: DEBUG nova.scheduler.client.report [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  713.115885] env[65478]: WARNING neutronclient.v2_0.client [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  713.323320] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Preparing fetch location {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:633}}
[  713.323320] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Creating directory with path [datastore1] vmware_temp/34c32dc3-04d9-4ee3-b8f6-f5b3d47f5d76/901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  713.323320] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-c1ae4c1b-8e87-454c-9276-6c00537d4f73 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  713.335447] env[65478]: DEBUG nova.compute.manager [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  713.345199] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Created directory with path [datastore1] vmware_temp/34c32dc3-04d9-4ee3-b8f6-f5b3d47f5d76/901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  713.345199] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Fetch image to [datastore1] vmware_temp/34c32dc3-04d9-4ee3-b8f6-f5b3d47f5d76/901a05bf-ca6f-4e54-a6ec-7c357eec1043/tmp-sparse.vmdk {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:635}}
[  713.345390] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Downloading image file data 901a05bf-ca6f-4e54-a6ec-7c357eec1043 to [datastore1] vmware_temp/34c32dc3-04d9-4ee3-b8f6-f5b3d47f5d76/901a05bf-ca6f-4e54-a6ec-7c357eec1043/tmp-sparse.vmdk on the data store datastore1 {{(pid=65478) _fetch_image_as_file /opt/stack/nova/nova/virt/vmwareapi/vmops.py:399}}
[  713.346477] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-5cd455cf-f5f7-4110-abbd-d371d7778dcc {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  713.355817] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b9025da9-fe93-41b8-a8b6-7b6edb18b046 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  713.368162] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-785bf8e6-c126-4312-99ed-734741a3a937 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  713.398046] env[65478]: DEBUG nova.virt.hardware [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  713.403521] env[65478]: DEBUG nova.virt.hardware [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  713.409124] env[65478]: DEBUG nova.virt.hardware [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  713.412403] env[65478]: DEBUG nova.virt.hardware [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  713.414099] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-bee69224-4f20-4686-b787-4532507cd7d3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  713.416152] env[65478]: DEBUG nova.virt.hardware [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  713.417636] env[65478]: DEBUG nova.virt.hardware [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  713.418095] env[65478]: DEBUG nova.virt.hardware [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  713.418322] env[65478]: DEBUG nova.virt.hardware [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  713.418700] env[65478]: DEBUG nova.virt.hardware [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  713.418938] env[65478]: DEBUG nova.virt.hardware [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  713.419987] env[65478]: DEBUG nova.virt.hardware [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  713.423721] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking SessionManager.AcquireGenericServiceTicket with opID=oslo.vmware-47d27f2c-7650-48d1-ad2f-6b5f0010ce97 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  713.425818] env[65478]: DEBUG oslo_vmware.service [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-580c4b71-6081-4819-a2a3-62e83bca06c5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  713.435795] env[65478]: DEBUG oslo_vmware.service [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c3eb8168-a1a8-4056-9fd4-20c90df6a2f5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  713.458905] env[65478]: DEBUG nova.virt.vmwareapi.images [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Downloading image file data 901a05bf-ca6f-4e54-a6ec-7c357eec1043 to the data store datastore1 {{(pid=65478) fetch_image /opt/stack/nova/nova/virt/vmwareapi/images.py:245}}
[  713.509305] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.394s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  713.510173] env[65478]: DEBUG nova.compute.manager [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  713.517947] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 5.919s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  713.517947] env[65478]: INFO nova.compute.claims [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  713.573239] env[65478]: DEBUG oslo_vmware.rw_handles [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Creating HTTP connection to write to file with size = 21318656 and URL = https://esx7c1n3.openstack.eu-de-1.cloud.sap:443/folder/vmware_temp/34c32dc3-04d9-4ee3-b8f6-f5b3d47f5d76/901a05bf-ca6f-4e54-a6ec-7c357eec1043/tmp-sparse.vmdk?dcPath=ha-datacenter&dsName=datastore1. {{(pid=65478) _create_write_connection /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:122}}
[  713.644684] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.virt.vmwareapi.images.image_transfer.<locals>.<lambda>' sleeping for 60.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[  713.993058] env[65478]: DEBUG nova.network.neutron [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Successfully created port: b521acaa-20d3-47d2-83e5-bf46598dcc68 {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  714.020826] env[65478]: WARNING nova.utils [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] The MainProcess.default pool does not have free threads so the task <bound method ComputeManager._allocate_network_async of <nova.compute.manager.ComputeManager object at 0x73d94c2e6500>> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  714.021334] env[65478]: DEBUG nova.compute.utils [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  714.097666] env[65478]: DEBUG nova.network.neutron [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  714.321351] env[65478]: DEBUG nova.compute.manager [req-62be6285-b3ce-4f24-950e-8f4ac2854c36 req-bb0b2e5d-d550-4a21-bb69-8abad1fa6f1a service nova] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Received event network-vif-plugged-c7a2377a-6ee6-4723-9536-d02ae3418549 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  714.321631] env[65478]: DEBUG oslo_concurrency.lockutils [req-62be6285-b3ce-4f24-950e-8f4ac2854c36 req-bb0b2e5d-d550-4a21-bb69-8abad1fa6f1a service nova] Acquiring lock "79200ab1-07f5-48a8-b2f0-b670852df5a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  714.322378] env[65478]: DEBUG oslo_concurrency.lockutils [req-62be6285-b3ce-4f24-950e-8f4ac2854c36 req-bb0b2e5d-d550-4a21-bb69-8abad1fa6f1a service nova] Lock "79200ab1-07f5-48a8-b2f0-b670852df5a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  714.322678] env[65478]: DEBUG oslo_concurrency.lockutils [req-62be6285-b3ce-4f24-950e-8f4ac2854c36 req-bb0b2e5d-d550-4a21-bb69-8abad1fa6f1a service nova] Lock "79200ab1-07f5-48a8-b2f0-b670852df5a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  714.323059] env[65478]: DEBUG nova.compute.manager [req-62be6285-b3ce-4f24-950e-8f4ac2854c36 req-bb0b2e5d-d550-4a21-bb69-8abad1fa6f1a service nova] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] No waiting events found dispatching network-vif-plugged-c7a2377a-6ee6-4723-9536-d02ae3418549 {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  714.323257] env[65478]: WARNING nova.compute.manager [req-62be6285-b3ce-4f24-950e-8f4ac2854c36 req-bb0b2e5d-d550-4a21-bb69-8abad1fa6f1a service nova] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Received unexpected event network-vif-plugged-c7a2377a-6ee6-4723-9536-d02ae3418549 for instance with vm_state building and task_state spawning.
[  714.333976] env[65478]: DEBUG oslo_vmware.rw_handles [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Completed reading data from the image iterator. {{(pid=65478) read /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:765}}
[  714.334365] env[65478]: DEBUG oslo_vmware.rw_handles [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Closing write handle for https://esx7c1n3.openstack.eu-de-1.cloud.sap:443/folder/vmware_temp/34c32dc3-04d9-4ee3-b8f6-f5b3d47f5d76/901a05bf-ca6f-4e54-a6ec-7c357eec1043/tmp-sparse.vmdk?dcPath=ha-datacenter&dsName=datastore1. {{(pid=65478) close /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:281}}
[  714.478324] env[65478]: DEBUG nova.virt.vmwareapi.images [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Downloaded image file data 901a05bf-ca6f-4e54-a6ec-7c357eec1043 to vmware_temp/34c32dc3-04d9-4ee3-b8f6-f5b3d47f5d76/901a05bf-ca6f-4e54-a6ec-7c357eec1043/tmp-sparse.vmdk on the data store datastore1 {{(pid=65478) fetch_image /opt/stack/nova/nova/virt/vmwareapi/images.py:258}}
[  714.480012] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Caching image {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:638}}
[  714.480012] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Copying Virtual Disk [datastore1] vmware_temp/34c32dc3-04d9-4ee3-b8f6-f5b3d47f5d76/901a05bf-ca6f-4e54-a6ec-7c357eec1043/tmp-sparse.vmdk to [datastore1] vmware_temp/34c32dc3-04d9-4ee3-b8f6-f5b3d47f5d76/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  714.480497] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-b58f958c-2859-4688-a326-15f9a415ad8f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  714.491855] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for the task: (returnval){
[  714.491855] env[65478]:    value = "task-6011430"
[  714.491855] env[65478]:    _type = "Task"
[  714.491855] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  714.506753] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011430, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  714.520944] env[65478]: DEBUG nova.network.neutron [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Updating instance_info_cache with network_info: [{"id": "c7a2377a-6ee6-4723-9536-d02ae3418549", "address": "fa:16:3e:b8:d0:b9", "network": {"id": "8419dcc5-ccb7-4667-a5ee-3f07016ddecd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "eb20b7ec77e847179c9940510a8b48bf", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "ec3f9e71-839a-429d-b211-d3dfc98ca4f6", "external-id": "nsx-vlan-transportzone-5", "segmentation_id": 5, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapc7a2377a-6e", "ovs_interfaceid": "c7a2377a-6ee6-4723-9536-d02ae3418549", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  714.530876] env[65478]: DEBUG nova.compute.manager [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  714.665552] env[65478]: DEBUG oslo_vmware.service [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-2e368ffa-1c7b-4226-99d1-7496cbb15ea5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  714.677522] env[65478]: DEBUG oslo_vmware.service [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-80fa7b97-bd01-4289-8e5f-78479a3cab98 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  714.707332] env[65478]: DEBUG oslo_vmware.service [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3a792621-8f3b-4988-90f7-6742f1e6fc81 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  714.715350] env[65478]: DEBUG oslo_vmware.service [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a73c767f-d8a6-4b09-887a-308f5f7350d0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  714.729854] env[65478]: DEBUG nova.compute.provider_tree [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  715.003175] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011430, 'name': CopyVirtualDisk_Task} progress is 100%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  715.026120] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Releasing lock "refresh_cache-79200ab1-07f5-48a8-b2f0-b670852df5a0" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  715.026453] env[65478]: DEBUG nova.compute.manager [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Instance network_info: |[{"id": "c7a2377a-6ee6-4723-9536-d02ae3418549", "address": "fa:16:3e:b8:d0:b9", "network": {"id": "8419dcc5-ccb7-4667-a5ee-3f07016ddecd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "eb20b7ec77e847179c9940510a8b48bf", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "ec3f9e71-839a-429d-b211-d3dfc98ca4f6", "external-id": "nsx-vlan-transportzone-5", "segmentation_id": 5, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapc7a2377a-6e", "ovs_interfaceid": "c7a2377a-6ee6-4723-9536-d02ae3418549", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  715.026739] env[65478]: DEBUG oslo_concurrency.lockutils [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Acquiring lock "95525483-b7db-427e-87b5-3f946972a250" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  715.027355] env[65478]: DEBUG oslo_concurrency.lockutils [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Lock "95525483-b7db-427e-87b5-3f946972a250" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  715.028624] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:b8:d0:b9', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': 'ec3f9e71-839a-429d-b211-d3dfc98ca4f6', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': 'c7a2377a-6ee6-4723-9536-d02ae3418549', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  715.038984] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Creating folder: Project (adc5e9cd81b34137a673792a172ebf17). Parent ref: group-v1161186. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  715.038984] env[65478]: DEBUG oslo_vmware.service [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-81ee2350-6ece-4c0f-9130-b4a480ed04de {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  715.050099] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Created folder: Project (adc5e9cd81b34137a673792a172ebf17) in parent group-v1161186.
[  715.050288] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Creating folder: Instances. Parent ref: group-v1161190. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  715.050529] env[65478]: DEBUG oslo_vmware.service [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-3157ff5f-811c-425b-9afb-141e85b5125d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  715.059649] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Created folder: Instances in parent group-v1161190.
[  715.061421] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  715.061705] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  715.062025] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-999e69ed-d41a-4eed-813c-21a66e29d7b9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  715.086603] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  715.086603] env[65478]:    value = "task-6011433"
[  715.086603] env[65478]:    _type = "Task"
[  715.086603] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  715.096173] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011433, 'name': CreateVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  715.234109] env[65478]: DEBUG nova.scheduler.client.report [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  715.501536] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011430, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.735951} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  715.501919] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Copied Virtual Disk [datastore1] vmware_temp/34c32dc3-04d9-4ee3-b8f6-f5b3d47f5d76/901a05bf-ca6f-4e54-a6ec-7c357eec1043/tmp-sparse.vmdk to [datastore1] vmware_temp/34c32dc3-04d9-4ee3-b8f6-f5b3d47f5d76/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  715.501919] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Deleting the datastore file [datastore1] vmware_temp/34c32dc3-04d9-4ee3-b8f6-f5b3d47f5d76/901a05bf-ca6f-4e54-a6ec-7c357eec1043/tmp-sparse.vmdk {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  715.502077] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-21822544-46f8-41ca-8b9b-15e01e98f817 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  715.508186] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for the task: (returnval){
[  715.508186] env[65478]:    value = "task-6011434"
[  715.508186] env[65478]:    _type = "Task"
[  715.508186] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  715.515751] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011434, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  715.537374] env[65478]: DEBUG nova.compute.manager [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  715.552039] env[65478]: DEBUG nova.compute.manager [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  715.586065] env[65478]: DEBUG nova.virt.hardware [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  715.586242] env[65478]: DEBUG nova.virt.hardware [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  715.586349] env[65478]: DEBUG nova.virt.hardware [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  715.586489] env[65478]: DEBUG nova.virt.hardware [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  715.586594] env[65478]: DEBUG nova.virt.hardware [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  715.586701] env[65478]: DEBUG nova.virt.hardware [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  715.586879] env[65478]: DEBUG nova.virt.hardware [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  715.587015] env[65478]: DEBUG nova.virt.hardware [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  715.587164] env[65478]: DEBUG nova.virt.hardware [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  715.590455] env[65478]: DEBUG nova.virt.hardware [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  715.590611] env[65478]: DEBUG nova.virt.hardware [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  715.591492] env[65478]: DEBUG oslo_vmware.service [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1fe201c9-38bf-4926-a4d1-3698d876e9ae {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  715.600079] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011433, 'name': CreateVM_Task, 'duration_secs': 0.32255} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  715.602938] env[65478]: DEBUG oslo_vmware.service [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3ddd57b9-d786-44cf-8854-aa830c3e839c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  715.607110] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  715.607576] env[65478]: WARNING neutronclient.v2_0.client [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  715.607982] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  715.608109] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  715.608377] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Acquired external semaphore "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  715.608643] env[65478]: DEBUG oslo_vmware.service [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-6388388e-8dc9-40df-a1a3-1f1635d55dfb {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  715.621228] env[65478]: DEBUG oslo_vmware.api [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Waiting for the task: (returnval){
[  715.621228] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52d4a1a5-abed-0ea2-32c7-a3c95690e39b"
[  715.621228] env[65478]:    _type = "Task"
[  715.621228] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  715.628268] env[65478]: DEBUG oslo_vmware.api [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52d4a1a5-abed-0ea2-32c7-a3c95690e39b, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  715.727480] env[65478]: DEBUG nova.network.neutron [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Successfully updated port: b521acaa-20d3-47d2-83e5-bf46598dcc68 {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  715.738050] env[65478]: WARNING neutronclient.v2_0.client [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  715.744829] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.234s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  715.745558] env[65478]: DEBUG nova.compute.manager [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  715.753421] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 3.926s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  716.022452] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011434, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.021385} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  716.022452] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  716.022452] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Moving file from [datastore1] vmware_temp/34c32dc3-04d9-4ee3-b8f6-f5b3d47f5d76/901a05bf-ca6f-4e54-a6ec-7c357eec1043 to [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043. {{(pid=65478) file_move /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:334}}
[  716.022452] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking FileManager.MoveDatastoreFile_Task with opID=oslo.vmware-36140571-b360-471d-8c32-f42f044a32bf {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  716.029222] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for the task: (returnval){
[  716.029222] env[65478]:    value = "task-6011435"
[  716.029222] env[65478]:    _type = "Task"
[  716.029222] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  716.038838] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011435, 'name': MoveDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  716.070707] env[65478]: DEBUG oslo_concurrency.lockutils [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  716.130994] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  716.131211] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  716.131385] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  716.230569] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Acquiring lock "refresh_cache-7507f1f3-c896-492c-9e9b-ebbd47b7c629" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  716.232125] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Acquired lock "refresh_cache-7507f1f3-c896-492c-9e9b-ebbd47b7c629" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  716.232125] env[65478]: DEBUG nova.network.neutron [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  716.255242] env[65478]: WARNING nova.utils [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] The MainProcess.default pool does not have free threads so the task <bound method ComputeManager._allocate_network_async of <nova.compute.manager.ComputeManager object at 0x73d94c2e6500>> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  716.255575] env[65478]: DEBUG nova.compute.utils [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  716.354210] env[65478]: DEBUG nova.network.neutron [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Updating instance_info_cache with network_info: [{"id": "5850a379-6213-4351-8b9c-5677d834c517", "address": "fa:16:3e:a7:e3:38", "network": {"id": "8419dcc5-ccb7-4667-a5ee-3f07016ddecd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "eb20b7ec77e847179c9940510a8b48bf", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "ec3f9e71-839a-429d-b211-d3dfc98ca4f6", "external-id": "nsx-vlan-transportzone-5", "segmentation_id": 5, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap5850a379-62", "ovs_interfaceid": "5850a379-6213-4351-8b9c-5677d834c517", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  716.547504] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011435, 'name': MoveDatastoreFile_Task, 'duration_secs': 0.023171} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  716.547881] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] File moved {{(pid=65478) file_move /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:346}}
[  716.547881] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Cleaning up location [datastore1] vmware_temp/34c32dc3-04d9-4ee3-b8f6-f5b3d47f5d76 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:640}}
[  716.548024] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Deleting the datastore file [datastore1] vmware_temp/34c32dc3-04d9-4ee3-b8f6-f5b3d47f5d76 {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  716.548613] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-a256ebf6-c1d3-4f28-a910-21e8c589bda2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  716.555226] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for the task: (returnval){
[  716.555226] env[65478]:    value = "task-6011436"
[  716.555226] env[65478]:    _type = "Task"
[  716.555226] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  716.564295] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011436, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  716.762899] env[65478]: DEBUG nova.compute.manager [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  716.778167] env[65478]: DEBUG nova.network.neutron [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  716.808876] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance caf7856c-4e51-4e6c-ad32-2088e15d5d8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  716.808876] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 79200ab1-07f5-48a8-b2f0-b670852df5a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  716.808876] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance f19f4a44-cae7-4ce1-ae57-a6155c93ed54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  716.808876] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 7507f1f3-c896-492c-9e9b-ebbd47b7c629 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  716.809409] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 230cc05f-433e-4510-947f-35466335662d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  716.809409] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 06b7de0a-c338-44b8-97e7-c80281067528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  716.858384] env[65478]: DEBUG oslo_concurrency.lockutils [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Releasing lock "refresh_cache-f19f4a44-cae7-4ce1-ae57-a6155c93ed54" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  716.859764] env[65478]: DEBUG nova.compute.manager [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Instance network_info: |[{"id": "5850a379-6213-4351-8b9c-5677d834c517", "address": "fa:16:3e:a7:e3:38", "network": {"id": "8419dcc5-ccb7-4667-a5ee-3f07016ddecd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "eb20b7ec77e847179c9940510a8b48bf", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "ec3f9e71-839a-429d-b211-d3dfc98ca4f6", "external-id": "nsx-vlan-transportzone-5", "segmentation_id": 5, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap5850a379-62", "ovs_interfaceid": "5850a379-6213-4351-8b9c-5677d834c517", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  716.860111] env[65478]: DEBUG nova.compute.manager [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  716.860705] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:a7:e3:38', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': 'ec3f9e71-839a-429d-b211-d3dfc98ca4f6', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': '5850a379-6213-4351-8b9c-5677d834c517', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  716.866013] env[65478]: DEBUG nova.network.neutron [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  716.872059] env[65478]: WARNING neutronclient.v2_0.client [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  716.872478] env[65478]: WARNING neutronclient.v2_0.client [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  716.877327] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Creating folder: Project (b3c94cfe27654d26bf3daa7e643aaffa). Parent ref: group-v1161186. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  716.877690] env[65478]: DEBUG oslo_vmware.service [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-db9da42d-879c-4eb3-a0b8-9759db2294ea {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  716.888587] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Created folder: Project (b3c94cfe27654d26bf3daa7e643aaffa) in parent group-v1161186.
[  716.888740] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Creating folder: Instances. Parent ref: group-v1161193. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  716.888981] env[65478]: DEBUG oslo_vmware.service [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-9268148a-d9e8-4bac-b91a-c3a084e21418 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  716.898438] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Created folder: Instances in parent group-v1161193.
[  716.899147] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  716.900347] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  716.900347] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-2dba3966-8a4b-474e-a436-f97008b0422a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  716.925760] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  716.925760] env[65478]:    value = "task-6011439"
[  716.925760] env[65478]:    _type = "Task"
[  716.925760] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  716.934815] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011439, 'name': CreateVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  716.952299] env[65478]: WARNING neutronclient.v2_0.client [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  716.999787] env[65478]: DEBUG nova.policy [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7215f90f08745348736565407233394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8c4a555eaa458ea33089c2385346b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  717.065236] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011436, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.024883} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  717.065400] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  717.066201] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-270fc6b3-b7c2-4cf9-873f-e67e40e191ba {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  717.072074] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for the task: (returnval){
[  717.072074] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52632ab7-d57c-7c42-7036-464974e28a49"
[  717.072074] env[65478]:    _type = "Task"
[  717.072074] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  717.083824] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52632ab7-d57c-7c42-7036-464974e28a49, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  717.311860] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 78246782-d2a2-4819-8924-51764ffe05aa has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  717.440288] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011439, 'name': CreateVM_Task, 'duration_secs': 0.298541} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  717.441050] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  717.441897] env[65478]: WARNING neutronclient.v2_0.client [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  717.445973] env[65478]: DEBUG oslo_concurrency.lockutils [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  717.445973] env[65478]: DEBUG oslo_concurrency.lockutils [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  717.445973] env[65478]: DEBUG oslo_concurrency.lockutils [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Acquired external semaphore "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  717.445973] env[65478]: DEBUG oslo_vmware.service [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-20419494-d2e6-4ef2-a9b7-b79fb2f57213 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  717.449085] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Waiting for the task: (returnval){
[  717.449085] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52326415-238f-aed9-1acb-1095720b78a6"
[  717.449085] env[65478]:    _type = "Task"
[  717.449085] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  717.461844] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52326415-238f-aed9-1acb-1095720b78a6, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  717.532570] env[65478]: DEBUG nova.network.neutron [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Successfully created port: 985b51bf-6e77-4d08-af82-c5fd27868326 {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  717.583502] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52632ab7-d57c-7c42-7036-464974e28a49, 'name': SearchDatastore_Task, 'duration_secs': 0.008798} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  717.583937] env[65478]: DEBUG oslo_concurrency.lockutils [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  717.584176] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Copying Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] caf7856c-4e51-4e6c-ad32-2088e15d5d8f/caf7856c-4e51-4e6c-ad32-2088e15d5d8f.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  717.584633] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  717.584876] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-faa9ee36-d3e3-4169-83df-0e3b0a18a087 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  717.587243] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Creating directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  717.587555] env[65478]: DEBUG oslo_vmware.service [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-5b0d4d12-73de-4361-8cb8-6f5b820b8d33 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  717.591812] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for the task: (returnval){
[  717.591812] env[65478]:    value = "task-6011440"
[  717.591812] env[65478]:    _type = "Task"
[  717.591812] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  717.596536] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Created directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  717.599953] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Folder [datastore1] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  717.600762] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011440, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  717.601688] env[65478]: DEBUG oslo_vmware.service [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-d945a98a-954b-4584-8cd5-b872eadaa169 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  717.607495] env[65478]: DEBUG oslo_vmware.api [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Waiting for the task: (returnval){
[  717.607495] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52bb1ac7-2126-99b1-9906-5f9c6662437b"
[  717.607495] env[65478]:    _type = "Task"
[  717.607495] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  717.615832] env[65478]: DEBUG oslo_vmware.api [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52bb1ac7-2126-99b1-9906-5f9c6662437b, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  717.687144] env[65478]: DEBUG nova.network.neutron [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Updating instance_info_cache with network_info: [{"id": "b521acaa-20d3-47d2-83e5-bf46598dcc68", "address": "fa:16:3e:79:eb:f7", "network": {"id": "8419dcc5-ccb7-4667-a5ee-3f07016ddecd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "eb20b7ec77e847179c9940510a8b48bf", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "ec3f9e71-839a-429d-b211-d3dfc98ca4f6", "external-id": "nsx-vlan-transportzone-5", "segmentation_id": 5, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapb521acaa-20", "ovs_interfaceid": "b521acaa-20d3-47d2-83e5-bf46598dcc68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  717.782072] env[65478]: DEBUG nova.compute.manager [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  717.815203] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 95525483-b7db-427e-87b5-3f946972a250 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  717.815455] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 6 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[  717.815922] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=1664MB phys_disk=100GB used_disk=6GB total_vcpus=48 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '6', 'num_vm_building': '6', 'num_task_spawning': '5', 'num_os_type_None': '6', 'num_proj_7dd8c4cd35c44466b1991950f28d886b': '1', 'io_workload': '6', 'num_proj_adc5e9cd81b34137a673792a172ebf17': '1', 'num_proj_b3c94cfe27654d26bf3daa7e643aaffa': '1', 'num_proj_37881a9fe4b44e59ade851fbf1800f39': '1', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_task_None': '1', 'num_proj_fba943d0315b45eb985b61d90b4ca7fa': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[  717.824017] env[65478]: DEBUG nova.virt.hardware [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  717.824250] env[65478]: DEBUG nova.virt.hardware [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  717.824370] env[65478]: DEBUG nova.virt.hardware [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  717.824553] env[65478]: DEBUG nova.virt.hardware [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  717.824703] env[65478]: DEBUG nova.virt.hardware [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  717.824798] env[65478]: DEBUG nova.virt.hardware [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  717.824953] env[65478]: DEBUG nova.virt.hardware [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  717.825986] env[65478]: DEBUG nova.virt.hardware [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  717.826188] env[65478]: DEBUG nova.virt.hardware [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  717.826322] env[65478]: DEBUG nova.virt.hardware [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  717.826461] env[65478]: DEBUG nova.virt.hardware [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  717.827545] env[65478]: DEBUG oslo_vmware.service [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-921831a9-fedb-45d5-988e-ee86c6be4e1e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  717.843227] env[65478]: DEBUG oslo_vmware.service [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4ba8b625-2100-4037-878f-08925ee0fcb0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  717.959057] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52326415-238f-aed9-1acb-1095720b78a6, 'name': SearchDatastore_Task, 'duration_secs': 0.01076} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  717.959300] env[65478]: DEBUG oslo_concurrency.lockutils [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  717.959494] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  717.959676] env[65478]: DEBUG oslo_concurrency.lockutils [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  717.994203] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9f4856a2-096f-4d5c-80ef-902e5064a6f0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  718.006874] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a56fba32-6aba-49af-83b0-47ef169d6e08 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  718.040633] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-67b534fb-aef3-4de9-bfef-985a2b76f95a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  718.047985] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4b6f9ea1-6888-4d17-841d-2c5be28dffb0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  718.060289] env[65478]: WARNING nova.utils [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d93aaa7760> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  718.069891] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  718.103998] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011440, 'name': CopyVirtualDisk_Task} progress is 77%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  718.119081] env[65478]: DEBUG oslo_vmware.api [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52bb1ac7-2126-99b1-9906-5f9c6662437b, 'name': SearchDatastore_Task, 'duration_secs': 0.0081} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  718.119924] env[65478]: DEBUG oslo_vmware.service [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-9555613b-ca68-48cd-8821-356a70a70305 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  718.125962] env[65478]: DEBUG oslo_vmware.api [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Waiting for the task: (returnval){
[  718.125962] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]5236394a-3748-6b23-9c70-4c3f42cde844"
[  718.125962] env[65478]:    _type = "Task"
[  718.125962] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  718.135336] env[65478]: DEBUG oslo_vmware.api [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5236394a-3748-6b23-9c70-4c3f42cde844, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  718.192170] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Releasing lock "refresh_cache-7507f1f3-c896-492c-9e9b-ebbd47b7c629" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  718.192501] env[65478]: DEBUG nova.compute.manager [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Instance network_info: |[{"id": "b521acaa-20d3-47d2-83e5-bf46598dcc68", "address": "fa:16:3e:79:eb:f7", "network": {"id": "8419dcc5-ccb7-4667-a5ee-3f07016ddecd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "eb20b7ec77e847179c9940510a8b48bf", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "ec3f9e71-839a-429d-b211-d3dfc98ca4f6", "external-id": "nsx-vlan-transportzone-5", "segmentation_id": 5, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapb521acaa-20", "ovs_interfaceid": "b521acaa-20d3-47d2-83e5-bf46598dcc68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  718.192756] env[65478]: DEBUG nova.compute.manager [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Not allocating networking since 'none' was specified. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2039}}
[  718.193360] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:79:eb:f7', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': 'ec3f9e71-839a-429d-b211-d3dfc98ca4f6', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': 'b521acaa-20d3-47d2-83e5-bf46598dcc68', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  718.199162] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Acquiring lock "c444ace8-9651-4df8-8604-982300643449" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  718.203931] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Instance VIF info [] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  718.209420] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Lock "c444ace8-9651-4df8-8604-982300643449" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.006s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  718.210657] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Creating folder: Project (37881a9fe4b44e59ade851fbf1800f39). Parent ref: group-v1161186. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  718.211437] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Creating folder: Project (fba943d0315b45eb985b61d90b4ca7fa). Parent ref: group-v1161186. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  718.212066] env[65478]: DEBUG oslo_vmware.service [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-fb97c390-bec1-4557-91e2-f2e7bd379490 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  718.213450] env[65478]: DEBUG oslo_vmware.service [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-cfab9dcc-74c3-430a-bb1a-ceba6ec45271 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  718.223291] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Created folder: Project (37881a9fe4b44e59ade851fbf1800f39) in parent group-v1161186.
[  718.223291] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Creating folder: Instances. Parent ref: group-v1161196. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  718.223632] env[65478]: DEBUG oslo_vmware.service [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-40b88630-2624-43eb-9b1a-9e31bd3cae03 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  718.227110] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Created folder: Project (fba943d0315b45eb985b61d90b4ca7fa) in parent group-v1161186.
[  718.227906] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Creating folder: Instances. Parent ref: group-v1161197. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  718.228408] env[65478]: DEBUG oslo_vmware.service [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-8abf89a8-034b-4f7c-94d6-dc12007fbafa {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  718.232504] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Created folder: Instances in parent group-v1161196.
[  718.234192] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  718.235096] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  718.235341] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-5238131d-a03d-48b5-9bba-86591a43c0ea {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  718.244655] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Created folder: Instances in parent group-v1161197.
[  718.256738] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  718.259538] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  718.259538] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-d0a1a9d8-9949-4d24-9568-fa19c2388f99 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  718.275741] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  718.275741] env[65478]:    value = "task-6011445"
[  718.275741] env[65478]:    _type = "Task"
[  718.275741] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  718.282583] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  718.282583] env[65478]:    value = "task-6011446"
[  718.282583] env[65478]:    _type = "Task"
[  718.282583] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  718.290081] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011445, 'name': CreateVM_Task} progress is 15%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  718.293989] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011446, 'name': CreateVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  718.574066] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  718.602559] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011440, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.543522} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  718.604721] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Copied Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] caf7856c-4e51-4e6c-ad32-2088e15d5d8f/caf7856c-4e51-4e6c-ad32-2088e15d5d8f.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  718.604721] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  718.604721] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-7c90ba0e-723a-42c3-919e-a8e0596d8841 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  718.609339] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for the task: (returnval){
[  718.609339] env[65478]:    value = "task-6011447"
[  718.609339] env[65478]:    _type = "Task"
[  718.609339] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  718.612999] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[  718.619622] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011447, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  718.640199] env[65478]: DEBUG oslo_vmware.api [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5236394a-3748-6b23-9c70-4c3f42cde844, 'name': SearchDatastore_Task, 'duration_secs': 0.010337} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  718.641125] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  718.641442] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Copying Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 79200ab1-07f5-48a8-b2f0-b670852df5a0/79200ab1-07f5-48a8-b2f0-b670852df5a0.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  718.642092] env[65478]: DEBUG oslo_concurrency.lockutils [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  718.642415] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Creating directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  718.645135] env[65478]: DEBUG oslo_vmware.service [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-80ffa1fa-541d-4c82-a257-183133f2ccf1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  718.645998] env[65478]: DEBUG oslo_vmware.service [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-cc62dbbb-8257-451e-978c-022edba01fb0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  718.653181] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Created directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  718.653181] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Folder [datastore1] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  718.653181] env[65478]: DEBUG oslo_vmware.service [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-c62f0997-d6db-4142-a579-284c62ca699b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  718.657707] env[65478]: DEBUG oslo_vmware.api [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Waiting for the task: (returnval){
[  718.657707] env[65478]:    value = "task-6011448"
[  718.657707] env[65478]:    _type = "Task"
[  718.657707] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  718.667049] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Waiting for the task: (returnval){
[  718.667049] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]524ec204-9a8b-185e-2785-f4b2a1bb7ae8"
[  718.667049] env[65478]:    _type = "Task"
[  718.667049] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  718.676478] env[65478]: DEBUG oslo_vmware.api [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Task: {'id': task-6011448, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  718.681654] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]524ec204-9a8b-185e-2785-f4b2a1bb7ae8, 'name': SearchDatastore_Task, 'duration_secs': 0.010117} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  718.682450] env[65478]: DEBUG oslo_vmware.service [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-7afdacb2-53e0-49d1-acfd-510258e644f5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  718.688208] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Waiting for the task: (returnval){
[  718.688208] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]522b75ac-4d2d-2c5d-8666-1e1c6c1fda16"
[  718.688208] env[65478]:    _type = "Task"
[  718.688208] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  718.695461] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]522b75ac-4d2d-2c5d-8666-1e1c6c1fda16, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  718.714239] env[65478]: DEBUG nova.compute.manager [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  718.785609] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011445, 'name': CreateVM_Task, 'duration_secs': 0.322154} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  718.788817] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  718.790797] env[65478]: WARNING neutronclient.v2_0.client [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  718.791251] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  718.791421] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  718.795320] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011446, 'name': CreateVM_Task, 'duration_secs': 0.267121} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  718.795522] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  718.795906] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Acquired external semaphore "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  718.796226] env[65478]: DEBUG oslo_vmware.service [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-f3f27716-90a9-45d3-ac96-753ad714e89b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  718.798432] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  718.801017] env[65478]: DEBUG oslo_vmware.api [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Waiting for the task: (returnval){
[  718.801017] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]529f6477-37ae-a5c7-6bff-037f979aa83d"
[  718.801017] env[65478]:    _type = "Task"
[  718.801017] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  718.809511] env[65478]: DEBUG oslo_vmware.api [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]529f6477-37ae-a5c7-6bff-037f979aa83d, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  719.079076] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[  719.079410] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.326s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  719.080034] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[  719.080608] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 6.748s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  719.083083] env[65478]: INFO nova.compute.claims [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  719.123556] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011447, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.061398} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  719.123556] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  719.123556] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6aeea3df-b088-49e7-abab-f2ffc7c68f1e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  719.149713] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Reconfiguring VM instance instance-00000001 to attach disk [datastore1] caf7856c-4e51-4e6c-ad32-2088e15d5d8f/caf7856c-4e51-4e6c-ad32-2088e15d5d8f.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  719.150526] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-bc609e8d-c4af-485a-8527-dfa590e55b16 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  719.186832] env[65478]: DEBUG oslo_vmware.api [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Task: {'id': task-6011448, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.506304} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  719.187028] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Copied Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 79200ab1-07f5-48a8-b2f0-b670852df5a0/79200ab1-07f5-48a8-b2f0-b670852df5a0.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  719.187844] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  719.189376] env[65478]: DEBUG oslo_vmware.service [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-7025faef-8ea5-467e-8d2b-e4a2ba9ad085 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  719.195837] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for the task: (returnval){
[  719.195837] env[65478]:    value = "task-6011449"
[  719.195837] env[65478]:    _type = "Task"
[  719.195837] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  719.208191] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]522b75ac-4d2d-2c5d-8666-1e1c6c1fda16, 'name': SearchDatastore_Task, 'duration_secs': 0.008463} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  719.209199] env[65478]: DEBUG oslo_concurrency.lockutils [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  719.210314] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Copying Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] f19f4a44-cae7-4ce1-ae57-a6155c93ed54/f19f4a44-cae7-4ce1-ae57-a6155c93ed54.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  719.210810] env[65478]: DEBUG oslo_vmware.api [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Waiting for the task: (returnval){
[  719.210810] env[65478]:    value = "task-6011450"
[  719.210810] env[65478]:    _type = "Task"
[  719.210810] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  719.214747] env[65478]: DEBUG oslo_vmware.service [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-015e14b9-4f90-44b4-92f0-852de58f47c0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  719.226578] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011449, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  719.229876] env[65478]: DEBUG oslo_vmware.api [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Task: {'id': task-6011450, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  719.236945] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Waiting for the task: (returnval){
[  719.236945] env[65478]:    value = "task-6011451"
[  719.236945] env[65478]:    _type = "Task"
[  719.236945] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  719.244931] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Task: {'id': task-6011451, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  719.252028] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  719.315938] env[65478]: DEBUG oslo_vmware.api [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]529f6477-37ae-a5c7-6bff-037f979aa83d, 'name': SearchDatastore_Task, 'duration_secs': 0.061574} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  719.316208] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  719.316422] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  719.316812] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  719.317013] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  719.317154] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  719.317398] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Creating directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  719.317776] env[65478]: DEBUG oslo_vmware.service [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-39059648-bfc1-48f4-8575-bc2733b7f559 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  719.319953] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Acquired external semaphore "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  719.320402] env[65478]: DEBUG oslo_vmware.service [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-dac5d8ee-3862-4abf-9df9-894205a42624 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  719.326399] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Created directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  719.327573] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Folder [datastore1] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  719.328289] env[65478]: DEBUG oslo_vmware.service [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-7fd0a265-9607-4da4-834d-a588789714a2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  719.333407] env[65478]: DEBUG oslo_vmware.api [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Waiting for the task: (returnval){
[  719.333407] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52852c79-bc3e-971b-f8ff-a6fc43e8a9cc"
[  719.333407] env[65478]:    _type = "Task"
[  719.333407] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  719.340914] env[65478]: DEBUG oslo_vmware.api [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Waiting for the task: (returnval){
[  719.340914] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52b49e82-b735-f252-a0e4-7db9dd561e5d"
[  719.340914] env[65478]:    _type = "Task"
[  719.340914] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  719.348439] env[65478]: DEBUG oslo_vmware.api [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52852c79-bc3e-971b-f8ff-a6fc43e8a9cc, 'name': SearchDatastore_Task, 'duration_secs': 0.008709} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  719.350187] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  719.356373] env[65478]: DEBUG oslo_vmware.api [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52b49e82-b735-f252-a0e4-7db9dd561e5d, 'name': SearchDatastore_Task, 'duration_secs': 0.008817} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  719.358588] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  719.359075] env[65478]: DEBUG oslo_vmware.service [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-444d280f-fb65-405b-a187-44028c1c6333 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  719.364272] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  719.368305] env[65478]: DEBUG oslo_vmware.api [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Waiting for the task: (returnval){
[  719.368305] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52938eec-f0e0-5bbd-6567-123b484c99ee"
[  719.368305] env[65478]:    _type = "Task"
[  719.368305] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  719.377698] env[65478]: DEBUG oslo_vmware.api [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52938eec-f0e0-5bbd-6567-123b484c99ee, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  719.420541] env[65478]: DEBUG nova.network.neutron [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Successfully updated port: 985b51bf-6e77-4d08-af82-c5fd27868326 {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  719.709499] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011449, 'name': ReconfigVM_Task, 'duration_secs': 0.31428} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  719.709768] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Reconfigured VM instance instance-00000001 to attach disk [datastore1] caf7856c-4e51-4e6c-ad32-2088e15d5d8f/caf7856c-4e51-4e6c-ad32-2088e15d5d8f.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  719.710508] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-25a21dae-10cd-4d82-a499-98bd7f1e83ed {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  719.722739] env[65478]: DEBUG oslo_vmware.api [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Task: {'id': task-6011450, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.061907} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  719.723985] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  719.724877] env[65478]: DEBUG oslo_vmware.service [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-823f7081-239b-4eba-8dc0-03a81437ea06 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  719.737214] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for the task: (returnval){
[  719.737214] env[65478]:    value = "task-6011452"
[  719.737214] env[65478]:    _type = "Task"
[  719.737214] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  719.760304] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Reconfiguring VM instance instance-00000002 to attach disk [datastore1] 79200ab1-07f5-48a8-b2f0-b670852df5a0/79200ab1-07f5-48a8-b2f0-b670852df5a0.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  719.761073] env[65478]: DEBUG oslo_vmware.service [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-cd94d8b0-5588-4d42-8390-11275a19367c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  719.768841] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Task: {'id': task-6011451, 'name': CopyVirtualDisk_Task} progress is 100%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  719.799560] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011452, 'name': Rename_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  719.801222] env[65478]: DEBUG oslo_vmware.api [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Waiting for the task: (returnval){
[  719.801222] env[65478]:    value = "task-6011453"
[  719.801222] env[65478]:    _type = "Task"
[  719.801222] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  719.811325] env[65478]: DEBUG oslo_vmware.api [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Task: {'id': task-6011453, 'name': ReconfigVM_Task} progress is 10%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  719.824678] env[65478]: DEBUG nova.compute.manager [req-28509a03-0696-4832-831c-79ecfdc01802 req-b682a784-a3ca-459e-b98c-73852b826f57 service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Received event network-changed-457c1734-c99a-4d71-a200-0341a9e3bdd8 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  719.824880] env[65478]: DEBUG nova.compute.manager [req-28509a03-0696-4832-831c-79ecfdc01802 req-b682a784-a3ca-459e-b98c-73852b826f57 service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Refreshing instance network info cache due to event network-changed-457c1734-c99a-4d71-a200-0341a9e3bdd8. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  719.825042] env[65478]: DEBUG oslo_concurrency.lockutils [req-28509a03-0696-4832-831c-79ecfdc01802 req-b682a784-a3ca-459e-b98c-73852b826f57 service nova] Acquiring lock "refresh_cache-caf7856c-4e51-4e6c-ad32-2088e15d5d8f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  719.825149] env[65478]: DEBUG oslo_concurrency.lockutils [req-28509a03-0696-4832-831c-79ecfdc01802 req-b682a784-a3ca-459e-b98c-73852b826f57 service nova] Acquired lock "refresh_cache-caf7856c-4e51-4e6c-ad32-2088e15d5d8f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  719.825272] env[65478]: DEBUG nova.network.neutron [req-28509a03-0696-4832-831c-79ecfdc01802 req-b682a784-a3ca-459e-b98c-73852b826f57 service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Refreshing network info cache for port 457c1734-c99a-4d71-a200-0341a9e3bdd8 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  719.886489] env[65478]: DEBUG oslo_vmware.api [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52938eec-f0e0-5bbd-6567-123b484c99ee, 'name': SearchDatastore_Task, 'duration_secs': 0.009149} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  719.886760] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  719.887153] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Copying Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 7507f1f3-c896-492c-9e9b-ebbd47b7c629/7507f1f3-c896-492c-9e9b-ebbd47b7c629.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  719.887557] env[65478]: DEBUG oslo_vmware.service [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-85dae84d-aac5-4f71-bc55-3b4c94b6d243 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  719.890197] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  719.890448] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Creating directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  719.890924] env[65478]: DEBUG oslo_vmware.service [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-c0a407b7-fab8-4804-ad10-d29917a39477 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  719.896591] env[65478]: DEBUG oslo_vmware.api [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Waiting for the task: (returnval){
[  719.896591] env[65478]:    value = "task-6011454"
[  719.896591] env[65478]:    _type = "Task"
[  719.896591] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  719.902697] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Created directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  719.904326] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Folder [datastore1] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  719.904326] env[65478]: DEBUG oslo_vmware.service [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-7fa83eb9-8600-4359-b28e-0d8fb1b254ac {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  719.911244] env[65478]: DEBUG oslo_vmware.api [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011454, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  719.913772] env[65478]: DEBUG oslo_vmware.api [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Waiting for the task: (returnval){
[  719.913772] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]521ee685-f702-0f7a-c0ec-7c6675396e15"
[  719.913772] env[65478]:    _type = "Task"
[  719.913772] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  719.928822] env[65478]: DEBUG oslo_vmware.api [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]521ee685-f702-0f7a-c0ec-7c6675396e15, 'name': SearchDatastore_Task, 'duration_secs': 0.009419} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  719.930532] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Acquiring lock "refresh_cache-230cc05f-433e-4510-947f-35466335662d" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  719.930532] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Acquired lock "refresh_cache-230cc05f-433e-4510-947f-35466335662d" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  719.930532] env[65478]: DEBUG oslo_vmware.service [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-45b94f91-1d31-428d-a71a-abdb22329552 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  719.932371] env[65478]: DEBUG nova.network.neutron [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  719.938062] env[65478]: DEBUG oslo_vmware.api [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Waiting for the task: (returnval){
[  719.938062] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52f4341f-9ff1-0d41-ab28-709fbb91173a"
[  719.938062] env[65478]:    _type = "Task"
[  719.938062] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  719.948701] env[65478]: DEBUG oslo_vmware.api [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52f4341f-9ff1-0d41-ab28-709fbb91173a, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  720.210551] env[65478]: DEBUG nova.compute.manager [req-29f84c71-3e4f-40e1-89ae-270dcf3fa699 req-723b44fd-2bdb-4c62-ac11-1270302ecc17 service nova] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Received event network-changed-c7a2377a-6ee6-4723-9536-d02ae3418549 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  720.212423] env[65478]: DEBUG nova.compute.manager [req-29f84c71-3e4f-40e1-89ae-270dcf3fa699 req-723b44fd-2bdb-4c62-ac11-1270302ecc17 service nova] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Refreshing instance network info cache due to event network-changed-c7a2377a-6ee6-4723-9536-d02ae3418549. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  720.212423] env[65478]: DEBUG oslo_concurrency.lockutils [req-29f84c71-3e4f-40e1-89ae-270dcf3fa699 req-723b44fd-2bdb-4c62-ac11-1270302ecc17 service nova] Acquiring lock "refresh_cache-79200ab1-07f5-48a8-b2f0-b670852df5a0" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  720.214048] env[65478]: DEBUG oslo_concurrency.lockutils [req-29f84c71-3e4f-40e1-89ae-270dcf3fa699 req-723b44fd-2bdb-4c62-ac11-1270302ecc17 service nova] Acquired lock "refresh_cache-79200ab1-07f5-48a8-b2f0-b670852df5a0" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  720.214113] env[65478]: DEBUG nova.network.neutron [req-29f84c71-3e4f-40e1-89ae-270dcf3fa699 req-723b44fd-2bdb-4c62-ac11-1270302ecc17 service nova] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Refreshing network info cache for port c7a2377a-6ee6-4723-9536-d02ae3418549 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  720.255543] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Task: {'id': task-6011451, 'name': CopyVirtualDisk_Task} progress is 100%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  720.261726] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011452, 'name': Rename_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  720.318047] env[65478]: DEBUG oslo_vmware.api [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Task: {'id': task-6011453, 'name': ReconfigVM_Task, 'duration_secs': 0.319972} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  720.321025] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Reconfigured VM instance instance-00000002 to attach disk [datastore1] 79200ab1-07f5-48a8-b2f0-b670852df5a0/79200ab1-07f5-48a8-b2f0-b670852df5a0.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  720.321025] env[65478]: DEBUG oslo_vmware.service [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-e64918a7-1784-4d84-979d-900dd4ecc49c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  720.328662] env[65478]: WARNING neutronclient.v2_0.client [req-28509a03-0696-4832-831c-79ecfdc01802 req-b682a784-a3ca-459e-b98c-73852b826f57 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  720.333152] env[65478]: DEBUG oslo_vmware.api [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Waiting for the task: (returnval){
[  720.333152] env[65478]:    value = "task-6011455"
[  720.333152] env[65478]:    _type = "Task"
[  720.333152] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  720.352018] env[65478]: DEBUG oslo_vmware.api [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Task: {'id': task-6011455, 'name': Rename_Task} progress is 5%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  720.378515] env[65478]: DEBUG oslo_vmware.service [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-44f4f90b-5e81-47d9-b156-4ef7bde71031 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  720.392250] env[65478]: DEBUG oslo_vmware.service [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-99f08791-ea0c-4925-84df-33fec8a47de8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  720.420048] env[65478]: DEBUG oslo_vmware.api [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011454, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  720.458588] env[65478]: DEBUG oslo_vmware.service [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-53fda3a9-f88f-47ea-83b4-2dd5c4ef590a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  720.466829] env[65478]: DEBUG oslo_vmware.api [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52f4341f-9ff1-0d41-ab28-709fbb91173a, 'name': SearchDatastore_Task, 'duration_secs': 0.009714} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  720.467262] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  720.467488] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Copying Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 06b7de0a-c338-44b8-97e7-c80281067528/06b7de0a-c338-44b8-97e7-c80281067528.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  720.467756] env[65478]: DEBUG oslo_vmware.service [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-e1558558-5ce0-4716-8a90-83d394eda6f9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  720.475447] env[65478]: DEBUG oslo_vmware.service [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a1a4ede0-c55b-4e0e-a3b4-2c91d03da871 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  720.483138] env[65478]: DEBUG oslo_vmware.api [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Waiting for the task: (returnval){
[  720.483138] env[65478]:    value = "task-6011456"
[  720.483138] env[65478]:    _type = "Task"
[  720.483138] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  720.497701] env[65478]: DEBUG nova.compute.provider_tree [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  720.502790] env[65478]: DEBUG oslo_vmware.api [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Task: {'id': task-6011456, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  720.512210] env[65478]: DEBUG nova.network.neutron [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  720.630294] env[65478]: WARNING neutronclient.v2_0.client [req-28509a03-0696-4832-831c-79ecfdc01802 req-b682a784-a3ca-459e-b98c-73852b826f57 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  720.663469] env[65478]: WARNING neutronclient.v2_0.client [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  720.723657] env[65478]: WARNING neutronclient.v2_0.client [req-29f84c71-3e4f-40e1-89ae-270dcf3fa699 req-723b44fd-2bdb-4c62-ac11-1270302ecc17 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  720.751605] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Task: {'id': task-6011451, 'name': CopyVirtualDisk_Task} progress is 100%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  720.758864] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011452, 'name': Rename_Task, 'duration_secs': 0.857403} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  720.759841] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  720.762955] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-75f0c012-e64b-4b69-86d3-be794494c176 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  720.770639] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for the task: (returnval){
[  720.770639] env[65478]:    value = "task-6011457"
[  720.770639] env[65478]:    _type = "Task"
[  720.770639] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  720.780370] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011457, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  720.843539] env[65478]: DEBUG oslo_vmware.api [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Task: {'id': task-6011455, 'name': Rename_Task, 'duration_secs': 0.215437} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  720.843785] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  720.844092] env[65478]: DEBUG oslo_vmware.service [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-3a95d3e6-6eaf-4cae-88e3-9c4db3836644 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  720.850229] env[65478]: DEBUG oslo_vmware.api [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Waiting for the task: (returnval){
[  720.850229] env[65478]:    value = "task-6011458"
[  720.850229] env[65478]:    _type = "Task"
[  720.850229] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  720.859590] env[65478]: DEBUG oslo_vmware.api [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Task: {'id': task-6011458, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  720.910032] env[65478]: DEBUG oslo_vmware.api [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011454, 'name': CopyVirtualDisk_Task} progress is 4%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  720.917796] env[65478]: DEBUG nova.network.neutron [req-28509a03-0696-4832-831c-79ecfdc01802 req-b682a784-a3ca-459e-b98c-73852b826f57 service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Updated VIF entry in instance network info cache for port 457c1734-c99a-4d71-a200-0341a9e3bdd8. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  720.918044] env[65478]: DEBUG nova.network.neutron [req-28509a03-0696-4832-831c-79ecfdc01802 req-b682a784-a3ca-459e-b98c-73852b826f57 service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Updating instance_info_cache with network_info: [{"id": "457c1734-c99a-4d71-a200-0341a9e3bdd8", "address": "fa:16:3e:90:77:31", "network": {"id": "eab0e877-79ef-45b8-a26f-7dd517a13b53", "bridge": "br-int", "label": "tempest-FloatingIPsAssociationTestJSON-364284774-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "7dd8c4cd35c44466b1991950f28d886b", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "054fcd1e-638e-425a-a1de-78cb188ae026", "external-id": "nsx-vlan-transportzone-658", "segmentation_id": 658, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap457c1734-c9", "ovs_interfaceid": "457c1734-c99a-4d71-a200-0341a9e3bdd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  720.993700] env[65478]: DEBUG oslo_vmware.api [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Task: {'id': task-6011456, 'name': CopyVirtualDisk_Task} progress is 4%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  721.035313] env[65478]: ERROR nova.scheduler.client.report [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [req-74491c2f-1f97-4c99-9149-a954caba17d4] Failed to update inventory to [{'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}}] for resource provider with UUID e3a5020e-0218-494b-ae38-8b55aa77f6f5.  Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n resource provider generation conflict  ", "code": "placement.concurrent_update", "request_id": "req-74491c2f-1f97-4c99-9149-a954caba17d4"}]}
[  721.062809] env[65478]: DEBUG nova.scheduler.client.report [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Refreshing inventories for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
[  721.070218] env[65478]: DEBUG nova.network.neutron [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Updating instance_info_cache with network_info: [{"id": "985b51bf-6e77-4d08-af82-c5fd27868326", "address": "fa:16:3e:23:32:ce", "network": {"id": "2c986fc6-30f7-4e87-b843-cd125149d427", "bridge": "br-int", "label": "tempest-ImagesOneServerNegativeTestJSON-213645312-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "0d8c4a555eaa458ea33089c2385346b7", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "8f40f5c4-c146-449c-884d-6f884dcf2acf", "external-id": "nsx-vlan-transportzone-240", "segmentation_id": 240, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap985b51bf-6e", "ovs_interfaceid": "985b51bf-6e77-4d08-af82-c5fd27868326", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  721.094519] env[65478]: DEBUG nova.scheduler.client.report [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Updating ProviderTree inventory for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
[  721.095447] env[65478]: DEBUG nova.compute.provider_tree [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  721.114088] env[65478]: DEBUG nova.scheduler.client.report [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Refreshing aggregate associations for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5, aggregates: None {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
[  721.136813] env[65478]: DEBUG nova.scheduler.client.report [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Refreshing trait associations for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_VMDK,COMPUTE_IMAGE_TYPE_ISO,HW_ARCH_X86_64,COMPUTE_SAME_HOST_COLD_MIGRATE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
[  721.251716] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Task: {'id': task-6011451, 'name': CopyVirtualDisk_Task, 'duration_secs': 1.512783} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  721.252152] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Copied Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] f19f4a44-cae7-4ce1-ae57-a6155c93ed54/f19f4a44-cae7-4ce1-ae57-a6155c93ed54.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  721.252152] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  721.252862] env[65478]: DEBUG oslo_vmware.service [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-1ede0a2b-1223-43ed-b752-f09b0b49c91c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  721.261040] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Waiting for the task: (returnval){
[  721.261040] env[65478]:    value = "task-6011459"
[  721.261040] env[65478]:    _type = "Task"
[  721.261040] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  721.270246] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Task: {'id': task-6011459, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  721.285565] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011457, 'name': PowerOnVM_Task} progress is 88%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  721.332372] env[65478]: DEBUG oslo_vmware.service [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-24cf89dd-fc37-4331-ad0b-8a03c4c5c2ce {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  721.341803] env[65478]: DEBUG oslo_vmware.service [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-16acdec3-1426-4938-9dd9-67a07a7c758e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  721.379510] env[65478]: DEBUG oslo_vmware.api [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Task: {'id': task-6011458, 'name': PowerOnVM_Task} progress is 89%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  721.392404] env[65478]: DEBUG oslo_vmware.service [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ccee0dbd-8bad-4c84-9951-762323cdaa38 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  721.401469] env[65478]: DEBUG oslo_vmware.service [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-baa8ecec-b5c0-49f4-9f58-0b7d1f7ab3df {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  721.434114] env[65478]: DEBUG nova.compute.provider_tree [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  721.437785] env[65478]: DEBUG oslo_vmware.api [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011454, 'name': CopyVirtualDisk_Task} progress is 77%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  721.441399] env[65478]: DEBUG oslo_concurrency.lockutils [req-28509a03-0696-4832-831c-79ecfdc01802 req-b682a784-a3ca-459e-b98c-73852b826f57 service nova] Releasing lock "refresh_cache-caf7856c-4e51-4e6c-ad32-2088e15d5d8f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  721.442804] env[65478]: DEBUG nova.compute.manager [req-28509a03-0696-4832-831c-79ecfdc01802 req-b682a784-a3ca-459e-b98c-73852b826f57 service nova] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Received event network-vif-plugged-5850a379-6213-4351-8b9c-5677d834c517 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  721.446621] env[65478]: DEBUG oslo_concurrency.lockutils [req-28509a03-0696-4832-831c-79ecfdc01802 req-b682a784-a3ca-459e-b98c-73852b826f57 service nova] Acquiring lock "f19f4a44-cae7-4ce1-ae57-a6155c93ed54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  721.446621] env[65478]: DEBUG oslo_concurrency.lockutils [req-28509a03-0696-4832-831c-79ecfdc01802 req-b682a784-a3ca-459e-b98c-73852b826f57 service nova] Lock "f19f4a44-cae7-4ce1-ae57-a6155c93ed54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  721.446621] env[65478]: DEBUG oslo_concurrency.lockutils [req-28509a03-0696-4832-831c-79ecfdc01802 req-b682a784-a3ca-459e-b98c-73852b826f57 service nova] Lock "f19f4a44-cae7-4ce1-ae57-a6155c93ed54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  721.446621] env[65478]: DEBUG nova.compute.manager [req-28509a03-0696-4832-831c-79ecfdc01802 req-b682a784-a3ca-459e-b98c-73852b826f57 service nova] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] No waiting events found dispatching network-vif-plugged-5850a379-6213-4351-8b9c-5677d834c517 {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  721.446621] env[65478]: WARNING nova.compute.manager [req-28509a03-0696-4832-831c-79ecfdc01802 req-b682a784-a3ca-459e-b98c-73852b826f57 service nova] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Received unexpected event network-vif-plugged-5850a379-6213-4351-8b9c-5677d834c517 for instance with vm_state building and task_state spawning.
[  721.446929] env[65478]: DEBUG nova.compute.manager [req-28509a03-0696-4832-831c-79ecfdc01802 req-b682a784-a3ca-459e-b98c-73852b826f57 service nova] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Received event network-changed-5850a379-6213-4351-8b9c-5677d834c517 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  721.446929] env[65478]: DEBUG nova.compute.manager [req-28509a03-0696-4832-831c-79ecfdc01802 req-b682a784-a3ca-459e-b98c-73852b826f57 service nova] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Refreshing instance network info cache due to event network-changed-5850a379-6213-4351-8b9c-5677d834c517. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  721.446929] env[65478]: DEBUG oslo_concurrency.lockutils [req-28509a03-0696-4832-831c-79ecfdc01802 req-b682a784-a3ca-459e-b98c-73852b826f57 service nova] Acquiring lock "refresh_cache-f19f4a44-cae7-4ce1-ae57-a6155c93ed54" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  721.446929] env[65478]: DEBUG oslo_concurrency.lockutils [req-28509a03-0696-4832-831c-79ecfdc01802 req-b682a784-a3ca-459e-b98c-73852b826f57 service nova] Acquired lock "refresh_cache-f19f4a44-cae7-4ce1-ae57-a6155c93ed54" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  721.447265] env[65478]: DEBUG nova.network.neutron [req-28509a03-0696-4832-831c-79ecfdc01802 req-b682a784-a3ca-459e-b98c-73852b826f57 service nova] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Refreshing network info cache for port 5850a379-6213-4351-8b9c-5677d834c517 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  721.493325] env[65478]: DEBUG oslo_vmware.api [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Task: {'id': task-6011456, 'name': CopyVirtualDisk_Task} progress is 89%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  721.575703] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Releasing lock "refresh_cache-230cc05f-433e-4510-947f-35466335662d" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  721.576047] env[65478]: DEBUG nova.compute.manager [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Instance network_info: |[{"id": "985b51bf-6e77-4d08-af82-c5fd27868326", "address": "fa:16:3e:23:32:ce", "network": {"id": "2c986fc6-30f7-4e87-b843-cd125149d427", "bridge": "br-int", "label": "tempest-ImagesOneServerNegativeTestJSON-213645312-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "0d8c4a555eaa458ea33089c2385346b7", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "8f40f5c4-c146-449c-884d-6f884dcf2acf", "external-id": "nsx-vlan-transportzone-240", "segmentation_id": 240, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap985b51bf-6e", "ovs_interfaceid": "985b51bf-6e77-4d08-af82-c5fd27868326", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  721.576306] env[65478]: DEBUG oslo_concurrency.lockutils [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Acquiring lock "98b2d40a-0c59-4540-b60e-17e5206dea42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  721.576489] env[65478]: DEBUG oslo_concurrency.lockutils [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Lock "98b2d40a-0c59-4540-b60e-17e5206dea42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  721.577747] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:23:32:ce', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': '8f40f5c4-c146-449c-884d-6f884dcf2acf', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': '985b51bf-6e77-4d08-af82-c5fd27868326', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  721.590288] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Creating folder: Project (0d8c4a555eaa458ea33089c2385346b7). Parent ref: group-v1161186. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  721.590804] env[65478]: DEBUG oslo_vmware.service [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-3cdcdeab-ac7a-4f0f-9790-842a0956b0ce {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  721.600307] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Created folder: Project (0d8c4a555eaa458ea33089c2385346b7) in parent group-v1161186.
[  721.600495] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Creating folder: Instances. Parent ref: group-v1161202. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  721.600746] env[65478]: DEBUG oslo_vmware.service [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-cf4a5cee-ab06-46d0-9c30-6a0015809361 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  721.611757] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Created folder: Instances in parent group-v1161202.
[  721.612626] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  721.613724] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 230cc05f-433e-4510-947f-35466335662d] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  721.614044] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-f2353610-1b89-467a-94ac-167d58b3deca {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  721.638969] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  721.638969] env[65478]:    value = "task-6011462"
[  721.638969] env[65478]:    _type = "Task"
[  721.638969] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  721.648622] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011462, 'name': CreateVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  721.722922] env[65478]: WARNING neutronclient.v2_0.client [req-29f84c71-3e4f-40e1-89ae-270dcf3fa699 req-723b44fd-2bdb-4c62-ac11-1270302ecc17 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  721.773398] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Task: {'id': task-6011459, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.278974} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  721.778605] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  721.779924] env[65478]: DEBUG oslo_vmware.service [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8a54c02d-6b0c-4e14-8752-1a0717449991 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  721.790020] env[65478]: DEBUG oslo_vmware.api [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011457, 'name': PowerOnVM_Task, 'duration_secs': 0.808478} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  721.790020] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  721.790020] env[65478]: INFO nova.compute.manager [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Took 15.31 seconds to spawn the instance on the hypervisor.
[  721.790020] env[65478]: DEBUG nova.compute.manager [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  721.790020] env[65478]: DEBUG oslo_vmware.service [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-268f6b6a-eb60-4435-891f-8718f0469706 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  721.828175] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Reconfiguring VM instance instance-00000003 to attach disk [datastore1] f19f4a44-cae7-4ce1-ae57-a6155c93ed54/f19f4a44-cae7-4ce1-ae57-a6155c93ed54.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  721.828473] env[65478]: DEBUG oslo_vmware.service [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-b8aed10f-2366-4d6f-9371-4aa1bd99e7f5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  721.854305] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Waiting for the task: (returnval){
[  721.854305] env[65478]:    value = "task-6011463"
[  721.854305] env[65478]:    _type = "Task"
[  721.854305] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  721.865748] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Task: {'id': task-6011463, 'name': ReconfigVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  721.870968] env[65478]: DEBUG oslo_vmware.api [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Task: {'id': task-6011458, 'name': PowerOnVM_Task, 'duration_secs': 0.598589} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  721.873804] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  721.873804] env[65478]: INFO nova.compute.manager [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Took 13.20 seconds to spawn the instance on the hypervisor.
[  721.873804] env[65478]: DEBUG nova.compute.manager [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  721.873804] env[65478]: DEBUG oslo_vmware.service [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d73664fc-01e3-42c4-bd16-924ef838ed14 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  721.927970] env[65478]: DEBUG oslo_vmware.api [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011454, 'name': CopyVirtualDisk_Task, 'duration_secs': 1.613319} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  721.928300] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Copied Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 7507f1f3-c896-492c-9e9b-ebbd47b7c629/7507f1f3-c896-492c-9e9b-ebbd47b7c629.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  721.928506] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  721.929059] env[65478]: DEBUG oslo_vmware.service [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-ee20d873-574d-4915-b369-810ed94d89cd {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  721.936493] env[65478]: DEBUG oslo_vmware.api [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Waiting for the task: (returnval){
[  721.936493] env[65478]:    value = "task-6011464"
[  721.936493] env[65478]:    _type = "Task"
[  721.936493] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  721.949027] env[65478]: DEBUG oslo_vmware.api [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011464, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  721.950233] env[65478]: WARNING neutronclient.v2_0.client [req-28509a03-0696-4832-831c-79ecfdc01802 req-b682a784-a3ca-459e-b98c-73852b826f57 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  721.989476] env[65478]: DEBUG nova.network.neutron [req-29f84c71-3e4f-40e1-89ae-270dcf3fa699 req-723b44fd-2bdb-4c62-ac11-1270302ecc17 service nova] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Updated VIF entry in instance network info cache for port c7a2377a-6ee6-4723-9536-d02ae3418549. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  721.990131] env[65478]: DEBUG nova.scheduler.client.report [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Updated inventory for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with generation 14 in Placement from set_inventory_for_provider using data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}}
[  721.991570] env[65478]: DEBUG nova.network.neutron [req-29f84c71-3e4f-40e1-89ae-270dcf3fa699 req-723b44fd-2bdb-4c62-ac11-1270302ecc17 service nova] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Updating instance_info_cache with network_info: [{"id": "c7a2377a-6ee6-4723-9536-d02ae3418549", "address": "fa:16:3e:b8:d0:b9", "network": {"id": "8419dcc5-ccb7-4667-a5ee-3f07016ddecd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "eb20b7ec77e847179c9940510a8b48bf", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "ec3f9e71-839a-429d-b211-d3dfc98ca4f6", "external-id": "nsx-vlan-transportzone-5", "segmentation_id": 5, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapc7a2377a-6e", "ovs_interfaceid": "c7a2377a-6ee6-4723-9536-d02ae3418549", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  721.994033] env[65478]: DEBUG nova.compute.provider_tree [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Updating resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 generation from 14 to 15 during operation: update_inventory {{(pid=65478) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
[  722.000330] env[65478]: DEBUG nova.compute.provider_tree [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  722.008360] env[65478]: DEBUG oslo_vmware.api [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Task: {'id': task-6011456, 'name': CopyVirtualDisk_Task, 'duration_secs': 1.029737} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  722.013515] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Copied Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 06b7de0a-c338-44b8-97e7-c80281067528/06b7de0a-c338-44b8-97e7-c80281067528.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  722.014535] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  722.014535] env[65478]: DEBUG oslo_vmware.service [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-4f58179c-7c60-47df-afdf-1c5786c85e99 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  722.020158] env[65478]: DEBUG oslo_vmware.api [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Waiting for the task: (returnval){
[  722.020158] env[65478]:    value = "task-6011465"
[  722.020158] env[65478]:    _type = "Task"
[  722.020158] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  722.029807] env[65478]: DEBUG oslo_vmware.api [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Task: {'id': task-6011465, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  722.079009] env[65478]: DEBUG nova.compute.manager [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  722.154591] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011462, 'name': CreateVM_Task, 'duration_secs': 0.318099} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  722.154591] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 230cc05f-433e-4510-947f-35466335662d] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  722.158355] env[65478]: WARNING neutronclient.v2_0.client [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  722.158732] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  722.158869] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  722.159396] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Acquired external semaphore "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  722.159701] env[65478]: DEBUG oslo_vmware.service [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-b70351fc-228d-4f65-a433-d575af2d5ded {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  722.166746] env[65478]: DEBUG oslo_vmware.api [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Waiting for the task: (returnval){
[  722.166746] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]5295bf66-84ce-f3a5-d496-0f9fb0e9cea8"
[  722.166746] env[65478]:    _type = "Task"
[  722.166746] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  722.175733] env[65478]: DEBUG oslo_vmware.api [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5295bf66-84ce-f3a5-d496-0f9fb0e9cea8, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  722.334953] env[65478]: INFO nova.compute.manager [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Took 20.15 seconds to build instance.
[  722.372946] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Task: {'id': task-6011463, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  722.395412] env[65478]: WARNING neutronclient.v2_0.client [req-28509a03-0696-4832-831c-79ecfdc01802 req-b682a784-a3ca-459e-b98c-73852b826f57 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  722.398909] env[65478]: INFO nova.compute.manager [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Took 20.20 seconds to build instance.
[  722.448237] env[65478]: DEBUG oslo_vmware.api [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011464, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.143097} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  722.448237] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  722.449942] env[65478]: DEBUG oslo_vmware.service [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8c4d2118-811e-4590-b8c0-93651a19a1c9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  722.477541] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Reconfiguring VM instance instance-00000004 to attach disk [datastore1] 7507f1f3-c896-492c-9e9b-ebbd47b7c629/7507f1f3-c896-492c-9e9b-ebbd47b7c629.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  722.478031] env[65478]: DEBUG oslo_vmware.service [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-8066b0a0-3a96-403b-8455-195076b9090b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  722.503532] env[65478]: DEBUG oslo_vmware.api [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Waiting for the task: (returnval){
[  722.503532] env[65478]:    value = "task-6011466"
[  722.503532] env[65478]:    _type = "Task"
[  722.503532] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  722.514710] env[65478]: DEBUG oslo_vmware.api [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011466, 'name': ReconfigVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  722.516647] env[65478]: DEBUG oslo_concurrency.lockutils [req-29f84c71-3e4f-40e1-89ae-270dcf3fa699 req-723b44fd-2bdb-4c62-ac11-1270302ecc17 service nova] Releasing lock "refresh_cache-79200ab1-07f5-48a8-b2f0-b670852df5a0" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  722.519443] env[65478]: DEBUG nova.compute.manager [req-29f84c71-3e4f-40e1-89ae-270dcf3fa699 req-723b44fd-2bdb-4c62-ac11-1270302ecc17 service nova] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Received event network-vif-plugged-b521acaa-20d3-47d2-83e5-bf46598dcc68 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  722.519443] env[65478]: DEBUG oslo_concurrency.lockutils [req-29f84c71-3e4f-40e1-89ae-270dcf3fa699 req-723b44fd-2bdb-4c62-ac11-1270302ecc17 service nova] Acquiring lock "7507f1f3-c896-492c-9e9b-ebbd47b7c629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  722.519443] env[65478]: DEBUG oslo_concurrency.lockutils [req-29f84c71-3e4f-40e1-89ae-270dcf3fa699 req-723b44fd-2bdb-4c62-ac11-1270302ecc17 service nova] Lock "7507f1f3-c896-492c-9e9b-ebbd47b7c629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  722.519443] env[65478]: DEBUG oslo_concurrency.lockutils [req-29f84c71-3e4f-40e1-89ae-270dcf3fa699 req-723b44fd-2bdb-4c62-ac11-1270302ecc17 service nova] Lock "7507f1f3-c896-492c-9e9b-ebbd47b7c629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  722.519443] env[65478]: DEBUG nova.compute.manager [req-29f84c71-3e4f-40e1-89ae-270dcf3fa699 req-723b44fd-2bdb-4c62-ac11-1270302ecc17 service nova] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] No waiting events found dispatching network-vif-plugged-b521acaa-20d3-47d2-83e5-bf46598dcc68 {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  722.519689] env[65478]: WARNING nova.compute.manager [req-29f84c71-3e4f-40e1-89ae-270dcf3fa699 req-723b44fd-2bdb-4c62-ac11-1270302ecc17 service nova] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Received unexpected event network-vif-plugged-b521acaa-20d3-47d2-83e5-bf46598dcc68 for instance with vm_state building and task_state spawning.
[  722.519689] env[65478]: DEBUG nova.compute.manager [req-29f84c71-3e4f-40e1-89ae-270dcf3fa699 req-723b44fd-2bdb-4c62-ac11-1270302ecc17 service nova] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Received event network-changed-b521acaa-20d3-47d2-83e5-bf46598dcc68 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  722.519689] env[65478]: DEBUG nova.compute.manager [req-29f84c71-3e4f-40e1-89ae-270dcf3fa699 req-723b44fd-2bdb-4c62-ac11-1270302ecc17 service nova] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Refreshing instance network info cache due to event network-changed-b521acaa-20d3-47d2-83e5-bf46598dcc68. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  722.519689] env[65478]: DEBUG oslo_concurrency.lockutils [req-29f84c71-3e4f-40e1-89ae-270dcf3fa699 req-723b44fd-2bdb-4c62-ac11-1270302ecc17 service nova] Acquiring lock "refresh_cache-7507f1f3-c896-492c-9e9b-ebbd47b7c629" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  722.519689] env[65478]: DEBUG oslo_concurrency.lockutils [req-29f84c71-3e4f-40e1-89ae-270dcf3fa699 req-723b44fd-2bdb-4c62-ac11-1270302ecc17 service nova] Acquired lock "refresh_cache-7507f1f3-c896-492c-9e9b-ebbd47b7c629" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  722.519887] env[65478]: DEBUG nova.network.neutron [req-29f84c71-3e4f-40e1-89ae-270dcf3fa699 req-723b44fd-2bdb-4c62-ac11-1270302ecc17 service nova] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Refreshing network info cache for port b521acaa-20d3-47d2-83e5-bf46598dcc68 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  722.519927] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.440s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  722.520422] env[65478]: DEBUG nova.compute.manager [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  722.541033] env[65478]: DEBUG oslo_concurrency.lockutils [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 6.450s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  722.546093] env[65478]: INFO nova.compute.claims [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  722.556767] env[65478]: DEBUG oslo_vmware.api [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Task: {'id': task-6011465, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.065004} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  722.557198] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  722.558770] env[65478]: DEBUG oslo_vmware.service [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6f9dcf83-f852-4af7-a3d9-83a847ec9fb0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  722.586506] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Reconfiguring VM instance instance-00000006 to attach disk [datastore1] 06b7de0a-c338-44b8-97e7-c80281067528/06b7de0a-c338-44b8-97e7-c80281067528.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  722.589526] env[65478]: DEBUG oslo_vmware.service [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-51c162f6-9ab2-49a7-911b-4467639398d1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  722.612895] env[65478]: DEBUG oslo_vmware.api [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Waiting for the task: (returnval){
[  722.612895] env[65478]:    value = "task-6011467"
[  722.612895] env[65478]:    _type = "Task"
[  722.612895] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  722.624781] env[65478]: DEBUG oslo_vmware.api [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Task: {'id': task-6011467, 'name': ReconfigVM_Task} progress is 10%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  722.626666] env[65478]: DEBUG nova.network.neutron [req-28509a03-0696-4832-831c-79ecfdc01802 req-b682a784-a3ca-459e-b98c-73852b826f57 service nova] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Updated VIF entry in instance network info cache for port 5850a379-6213-4351-8b9c-5677d834c517. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  722.628980] env[65478]: DEBUG nova.network.neutron [req-28509a03-0696-4832-831c-79ecfdc01802 req-b682a784-a3ca-459e-b98c-73852b826f57 service nova] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Updating instance_info_cache with network_info: [{"id": "5850a379-6213-4351-8b9c-5677d834c517", "address": "fa:16:3e:a7:e3:38", "network": {"id": "8419dcc5-ccb7-4667-a5ee-3f07016ddecd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "eb20b7ec77e847179c9940510a8b48bf", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "ec3f9e71-839a-429d-b211-d3dfc98ca4f6", "external-id": "nsx-vlan-transportzone-5", "segmentation_id": 5, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap5850a379-62", "ovs_interfaceid": "5850a379-6213-4351-8b9c-5677d834c517", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  722.636466] env[65478]: DEBUG oslo_concurrency.lockutils [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  722.676629] env[65478]: DEBUG oslo_vmware.api [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5295bf66-84ce-f3a5-d496-0f9fb0e9cea8, 'name': SearchDatastore_Task, 'duration_secs': 0.033642} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  722.676950] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  722.677195] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  722.677428] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  722.677539] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  722.677691] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Creating directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  722.678011] env[65478]: DEBUG oslo_vmware.service [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-ae1e625f-b8e2-49ee-925d-3e8ad4e16d6a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  722.688984] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Created directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  722.689048] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Folder [datastore1] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  722.690517] env[65478]: DEBUG oslo_vmware.service [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-783e1bda-5ee2-420c-ad92-962062872569 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  722.701786] env[65478]: DEBUG oslo_vmware.api [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Waiting for the task: (returnval){
[  722.701786] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52881bd1-360b-670e-856d-59e289a32b53"
[  722.701786] env[65478]:    _type = "Task"
[  722.701786] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  722.713273] env[65478]: DEBUG oslo_vmware.api [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52881bd1-360b-670e-856d-59e289a32b53, 'name': SearchDatastore_Task, 'duration_secs': 0.010177} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  722.714637] env[65478]: DEBUG oslo_vmware.service [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-a53e5732-1e13-4233-874e-31af3fd7de4a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  722.724028] env[65478]: DEBUG oslo_vmware.api [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Waiting for the task: (returnval){
[  722.724028] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52ccca2b-608c-90f8-c62d-bf5ddf3dff3c"
[  722.724028] env[65478]:    _type = "Task"
[  722.724028] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  722.738644] env[65478]: DEBUG oslo_vmware.api [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52ccca2b-608c-90f8-c62d-bf5ddf3dff3c, 'name': SearchDatastore_Task, 'duration_secs': 0.009176} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  722.741372] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  722.741676] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Copying Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 230cc05f-433e-4510-947f-35466335662d/230cc05f-433e-4510-947f-35466335662d.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  722.742137] env[65478]: DEBUG oslo_vmware.service [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-ce0e0bc0-2ff1-4a11-aaf2-e75e7dcb80cd {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  722.750552] env[65478]: DEBUG oslo_vmware.api [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Waiting for the task: (returnval){
[  722.750552] env[65478]:    value = "task-6011468"
[  722.750552] env[65478]:    _type = "Task"
[  722.750552] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  722.761832] env[65478]: DEBUG oslo_vmware.api [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011468, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  722.837481] env[65478]: DEBUG oslo_concurrency.lockutils [None req-f769fcbf-e286-4327-81dd-cdaa3c34bf46 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Lock "caf7856c-4e51-4e6c-ad32-2088e15d5d8f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.660s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  722.867521] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Task: {'id': task-6011463, 'name': ReconfigVM_Task, 'duration_secs': 0.88368} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  722.867831] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Reconfigured VM instance instance-00000003 to attach disk [datastore1] f19f4a44-cae7-4ce1-ae57-a6155c93ed54/f19f4a44-cae7-4ce1-ae57-a6155c93ed54.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  722.869113] env[65478]: DEBUG oslo_vmware.service [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-d1813ad0-f5f9-4a43-8949-9e2531d628d6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  722.877110] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Waiting for the task: (returnval){
[  722.877110] env[65478]:    value = "task-6011469"
[  722.877110] env[65478]:    _type = "Task"
[  722.877110] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  722.886807] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Task: {'id': task-6011469, 'name': Rename_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  722.900495] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2b345ecd-1e89-41bd-84fb-89392c8ec5d5 tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Lock "79200ab1-07f5-48a8-b2f0-b670852df5a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.729s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  723.019367] env[65478]: DEBUG oslo_vmware.api [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011466, 'name': ReconfigVM_Task, 'duration_secs': 0.437588} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  723.019666] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Reconfigured VM instance instance-00000004 to attach disk [datastore1] 7507f1f3-c896-492c-9e9b-ebbd47b7c629/7507f1f3-c896-492c-9e9b-ebbd47b7c629.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  723.020496] env[65478]: DEBUG oslo_vmware.service [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-f6b627e2-1dbe-4f75-84a2-19f16d560f22 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  723.027563] env[65478]: DEBUG oslo_vmware.api [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Waiting for the task: (returnval){
[  723.027563] env[65478]:    value = "task-6011470"
[  723.027563] env[65478]:    _type = "Task"
[  723.027563] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  723.036216] env[65478]: WARNING neutronclient.v2_0.client [req-29f84c71-3e4f-40e1-89ae-270dcf3fa699 req-723b44fd-2bdb-4c62-ac11-1270302ecc17 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  723.043467] env[65478]: DEBUG oslo_vmware.api [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011470, 'name': Rename_Task} progress is 10%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  723.050374] env[65478]: DEBUG nova.compute.utils [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  723.053321] env[65478]: DEBUG nova.compute.manager [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  723.055962] env[65478]: DEBUG nova.network.neutron [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  723.055962] env[65478]: WARNING neutronclient.v2_0.client [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  723.055962] env[65478]: WARNING neutronclient.v2_0.client [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  723.127275] env[65478]: DEBUG oslo_vmware.api [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Task: {'id': task-6011467, 'name': ReconfigVM_Task, 'duration_secs': 0.287808} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  723.127818] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Reconfigured VM instance instance-00000006 to attach disk [datastore1] 06b7de0a-c338-44b8-97e7-c80281067528/06b7de0a-c338-44b8-97e7-c80281067528.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  723.128593] env[65478]: DEBUG oslo_vmware.service [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-0adbec3f-6d22-4bf2-b3e0-009ad411aaf7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  723.131262] env[65478]: DEBUG oslo_concurrency.lockutils [req-28509a03-0696-4832-831c-79ecfdc01802 req-b682a784-a3ca-459e-b98c-73852b826f57 service nova] Releasing lock "refresh_cache-f19f4a44-cae7-4ce1-ae57-a6155c93ed54" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  723.136964] env[65478]: DEBUG oslo_vmware.api [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Waiting for the task: (returnval){
[  723.136964] env[65478]:    value = "task-6011471"
[  723.136964] env[65478]:    _type = "Task"
[  723.136964] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  723.147802] env[65478]: DEBUG oslo_vmware.api [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Task: {'id': task-6011471, 'name': Rename_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  723.261533] env[65478]: DEBUG oslo_vmware.api [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011468, 'name': CopyVirtualDisk_Task} progress is 89%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  723.386879] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Task: {'id': task-6011469, 'name': Rename_Task, 'duration_secs': 0.246987} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  723.387750] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  723.387750] env[65478]: DEBUG oslo_vmware.service [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-8f54b964-882e-46be-bd82-c10532d7343c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  723.398095] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Waiting for the task: (returnval){
[  723.398095] env[65478]:    value = "task-6011472"
[  723.398095] env[65478]:    _type = "Task"
[  723.398095] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  723.401762] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Task: {'id': task-6011472, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  723.407601] env[65478]: DEBUG nova.policy [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '09baaa103fee408cb0b59c39496c3d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a0ae95d73f4678b203b7db9a0d36a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  723.537100] env[65478]: DEBUG oslo_vmware.api [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011470, 'name': Rename_Task, 'duration_secs': 0.19266} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  723.537326] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  723.537559] env[65478]: DEBUG oslo_vmware.service [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-b553b06c-f321-489c-b9bc-c921bcf66387 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  723.543982] env[65478]: DEBUG oslo_vmware.api [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Waiting for the task: (returnval){
[  723.543982] env[65478]:    value = "task-6011473"
[  723.543982] env[65478]:    _type = "Task"
[  723.543982] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  723.552934] env[65478]: DEBUG oslo_vmware.api [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011473, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  723.555382] env[65478]: DEBUG nova.compute.manager [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  723.650584] env[65478]: DEBUG oslo_vmware.api [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Task: {'id': task-6011471, 'name': Rename_Task, 'duration_secs': 0.165488} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  723.651861] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  723.651861] env[65478]: DEBUG oslo_vmware.service [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-1f16b844-6c30-4d8c-bb71-ec71b62762cb {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  723.658078] env[65478]: DEBUG oslo_vmware.api [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Waiting for the task: (returnval){
[  723.658078] env[65478]:    value = "task-6011474"
[  723.658078] env[65478]:    _type = "Task"
[  723.658078] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  723.671235] env[65478]: DEBUG oslo_vmware.api [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Task: {'id': task-6011474, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  723.769147] env[65478]: DEBUG oslo_vmware.api [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011468, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.524841} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  723.769361] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Copied Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 230cc05f-433e-4510-947f-35466335662d/230cc05f-433e-4510-947f-35466335662d.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  723.769506] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  723.770399] env[65478]: DEBUG oslo_vmware.service [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-f35cd8fe-3da1-4ebc-9da8-5370bc38b5e7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  723.778310] env[65478]: DEBUG oslo_vmware.api [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Waiting for the task: (returnval){
[  723.778310] env[65478]:    value = "task-6011475"
[  723.778310] env[65478]:    _type = "Task"
[  723.778310] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  723.788386] env[65478]: DEBUG oslo_vmware.api [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011475, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  723.806270] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-bac0b5ab-1717-4f32-96d9-530dcf7015b6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  723.816281] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8dbeec3a-6233-4fc3-a2f3-cec76e8afb4a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  723.857914] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8c9f219b-d40b-44d1-b8f8-fdce5f151402 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  723.866138] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d94b397c-19d6-45f1-a9f1-4d2ff36e67ad {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  723.880385] env[65478]: DEBUG nova.compute.provider_tree [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  723.904754] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Task: {'id': task-6011472, 'name': PowerOnVM_Task} progress is 1%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  724.028800] env[65478]: DEBUG nova.network.neutron [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Successfully created port: 09df3109-08b1-49d4-8a44-1f111fb53582 {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  724.057632] env[65478]: DEBUG oslo_vmware.api [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011473, 'name': PowerOnVM_Task} progress is 88%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  724.170720] env[65478]: DEBUG oslo_vmware.api [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Task: {'id': task-6011474, 'name': PowerOnVM_Task} progress is 88%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  724.289823] env[65478]: DEBUG oslo_vmware.api [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011475, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.072643} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  724.290103] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  724.291209] env[65478]: DEBUG oslo_vmware.service [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-63fc6be4-2f2d-4a91-9672-d68c10c4082b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  724.322967] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Reconfiguring VM instance instance-00000005 to attach disk [datastore1] 230cc05f-433e-4510-947f-35466335662d/230cc05f-433e-4510-947f-35466335662d.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  724.324795] env[65478]: DEBUG oslo_vmware.service [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-f31a502b-4cae-4ed7-a231-03795fda3b7a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  724.346479] env[65478]: DEBUG oslo_vmware.api [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Waiting for the task: (returnval){
[  724.346479] env[65478]:    value = "task-6011476"
[  724.346479] env[65478]:    _type = "Task"
[  724.346479] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  724.357953] env[65478]: DEBUG oslo_vmware.api [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011476, 'name': ReconfigVM_Task} progress is 10%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  724.387676] env[65478]: DEBUG nova.scheduler.client.report [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  724.403806] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Task: {'id': task-6011472, 'name': PowerOnVM_Task} progress is 64%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  724.555260] env[65478]: DEBUG oslo_vmware.api [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011473, 'name': PowerOnVM_Task, 'duration_secs': 0.728402} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  724.555419] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  724.555605] env[65478]: INFO nova.compute.manager [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Took 11.22 seconds to spawn the instance on the hypervisor.
[  724.556197] env[65478]: DEBUG nova.compute.manager [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  724.557058] env[65478]: DEBUG oslo_vmware.service [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-7e426118-b568-4b46-871b-9a5ff63dda07 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  724.571020] env[65478]: DEBUG nova.compute.manager [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  724.603295] env[65478]: DEBUG nova.virt.hardware [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  724.604324] env[65478]: DEBUG nova.virt.hardware [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  724.604324] env[65478]: DEBUG nova.virt.hardware [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  724.604324] env[65478]: DEBUG nova.virt.hardware [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  724.604324] env[65478]: DEBUG nova.virt.hardware [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  724.604324] env[65478]: DEBUG nova.virt.hardware [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  724.604550] env[65478]: DEBUG nova.virt.hardware [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  724.604690] env[65478]: DEBUG nova.virt.hardware [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  724.604727] env[65478]: DEBUG nova.virt.hardware [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  724.604993] env[65478]: DEBUG nova.virt.hardware [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  724.605625] env[65478]: DEBUG nova.virt.hardware [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  724.606486] env[65478]: DEBUG oslo_vmware.service [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-253966a0-1cb0-42b1-950c-3f29fcc3a24c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  724.615831] env[65478]: DEBUG oslo_vmware.service [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-7092a420-14ce-41bc-9d51-33f4d9f7c8e9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  724.671235] env[65478]: DEBUG oslo_vmware.api [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Task: {'id': task-6011474, 'name': PowerOnVM_Task, 'duration_secs': 0.693608} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  724.671528] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  724.672063] env[65478]: INFO nova.compute.manager [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Took 6.89 seconds to spawn the instance on the hypervisor.
[  724.672063] env[65478]: DEBUG nova.compute.manager [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  724.672740] env[65478]: DEBUG oslo_vmware.service [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b0f641f5-6398-4e62-bb75-6dc0f1384e65 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  724.775084] env[65478]: WARNING neutronclient.v2_0.client [req-29f84c71-3e4f-40e1-89ae-270dcf3fa699 req-723b44fd-2bdb-4c62-ac11-1270302ecc17 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  724.839123] env[65478]: DEBUG nova.compute.manager [req-94ac9235-5170-4c97-93ad-896b43e349a9 req-cc1ab129-009f-4182-92fd-9536213ab0e4 service nova] [instance: 230cc05f-433e-4510-947f-35466335662d] Received event network-vif-plugged-985b51bf-6e77-4d08-af82-c5fd27868326 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  724.839123] env[65478]: DEBUG oslo_concurrency.lockutils [req-94ac9235-5170-4c97-93ad-896b43e349a9 req-cc1ab129-009f-4182-92fd-9536213ab0e4 service nova] Acquiring lock "230cc05f-433e-4510-947f-35466335662d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  724.839281] env[65478]: DEBUG oslo_concurrency.lockutils [req-94ac9235-5170-4c97-93ad-896b43e349a9 req-cc1ab129-009f-4182-92fd-9536213ab0e4 service nova] Lock "230cc05f-433e-4510-947f-35466335662d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  724.840176] env[65478]: DEBUG oslo_concurrency.lockutils [req-94ac9235-5170-4c97-93ad-896b43e349a9 req-cc1ab129-009f-4182-92fd-9536213ab0e4 service nova] Lock "230cc05f-433e-4510-947f-35466335662d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  724.840896] env[65478]: DEBUG nova.compute.manager [req-94ac9235-5170-4c97-93ad-896b43e349a9 req-cc1ab129-009f-4182-92fd-9536213ab0e4 service nova] [instance: 230cc05f-433e-4510-947f-35466335662d] No waiting events found dispatching network-vif-plugged-985b51bf-6e77-4d08-af82-c5fd27868326 {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  724.841061] env[65478]: WARNING nova.compute.manager [req-94ac9235-5170-4c97-93ad-896b43e349a9 req-cc1ab129-009f-4182-92fd-9536213ab0e4 service nova] [instance: 230cc05f-433e-4510-947f-35466335662d] Received unexpected event network-vif-plugged-985b51bf-6e77-4d08-af82-c5fd27868326 for instance with vm_state building and task_state spawning.
[  724.841193] env[65478]: DEBUG nova.compute.manager [req-94ac9235-5170-4c97-93ad-896b43e349a9 req-cc1ab129-009f-4182-92fd-9536213ab0e4 service nova] [instance: 230cc05f-433e-4510-947f-35466335662d] Received event network-changed-985b51bf-6e77-4d08-af82-c5fd27868326 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  724.841545] env[65478]: DEBUG nova.compute.manager [req-94ac9235-5170-4c97-93ad-896b43e349a9 req-cc1ab129-009f-4182-92fd-9536213ab0e4 service nova] [instance: 230cc05f-433e-4510-947f-35466335662d] Refreshing instance network info cache due to event network-changed-985b51bf-6e77-4d08-af82-c5fd27868326. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  724.841674] env[65478]: DEBUG oslo_concurrency.lockutils [req-94ac9235-5170-4c97-93ad-896b43e349a9 req-cc1ab129-009f-4182-92fd-9536213ab0e4 service nova] Acquiring lock "refresh_cache-230cc05f-433e-4510-947f-35466335662d" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  724.842489] env[65478]: DEBUG oslo_concurrency.lockutils [req-94ac9235-5170-4c97-93ad-896b43e349a9 req-cc1ab129-009f-4182-92fd-9536213ab0e4 service nova] Acquired lock "refresh_cache-230cc05f-433e-4510-947f-35466335662d" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  724.842489] env[65478]: DEBUG nova.network.neutron [req-94ac9235-5170-4c97-93ad-896b43e349a9 req-cc1ab129-009f-4182-92fd-9536213ab0e4 service nova] [instance: 230cc05f-433e-4510-947f-35466335662d] Refreshing network info cache for port 985b51bf-6e77-4d08-af82-c5fd27868326 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  724.856340] env[65478]: DEBUG oslo_vmware.api [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011476, 'name': ReconfigVM_Task, 'duration_secs': 0.500891} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  724.857585] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Reconfigured VM instance instance-00000005 to attach disk [datastore1] 230cc05f-433e-4510-947f-35466335662d/230cc05f-433e-4510-947f-35466335662d.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  724.858372] env[65478]: DEBUG oslo_vmware.service [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-9297e949-4d00-4f62-a1c2-7f335fd7a941 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  724.867632] env[65478]: DEBUG oslo_vmware.api [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Waiting for the task: (returnval){
[  724.867632] env[65478]:    value = "task-6011477"
[  724.867632] env[65478]:    _type = "Task"
[  724.867632] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  724.876600] env[65478]: DEBUG oslo_vmware.api [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011477, 'name': Rename_Task} progress is 5%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  724.895116] env[65478]: DEBUG oslo_concurrency.lockutils [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.374s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  724.900615] env[65478]: DEBUG nova.compute.manager [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  724.905452] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 5.653s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  724.909668] env[65478]: INFO nova.compute.claims [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  724.915877] env[65478]: DEBUG oslo_vmware.api [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Task: {'id': task-6011472, 'name': PowerOnVM_Task, 'duration_secs': 1.424623} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  724.916927] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  724.917822] env[65478]: INFO nova.compute.manager [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Took 14.03 seconds to spawn the instance on the hypervisor.
[  724.918177] env[65478]: DEBUG nova.compute.manager [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  724.919226] env[65478]: DEBUG oslo_vmware.service [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b18aab9b-022b-4f26-a907-9d1442b51c2a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  724.981963] env[65478]: DEBUG nova.network.neutron [req-29f84c71-3e4f-40e1-89ae-270dcf3fa699 req-723b44fd-2bdb-4c62-ac11-1270302ecc17 service nova] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Updated VIF entry in instance network info cache for port b521acaa-20d3-47d2-83e5-bf46598dcc68. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  724.982536] env[65478]: DEBUG nova.network.neutron [req-29f84c71-3e4f-40e1-89ae-270dcf3fa699 req-723b44fd-2bdb-4c62-ac11-1270302ecc17 service nova] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Updating instance_info_cache with network_info: [{"id": "b521acaa-20d3-47d2-83e5-bf46598dcc68", "address": "fa:16:3e:79:eb:f7", "network": {"id": "8419dcc5-ccb7-4667-a5ee-3f07016ddecd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "eb20b7ec77e847179c9940510a8b48bf", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "ec3f9e71-839a-429d-b211-d3dfc98ca4f6", "external-id": "nsx-vlan-transportzone-5", "segmentation_id": 5, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapb521acaa-20", "ovs_interfaceid": "b521acaa-20d3-47d2-83e5-bf46598dcc68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  725.079578] env[65478]: INFO nova.compute.manager [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Took 20.44 seconds to build instance.
[  725.195408] env[65478]: INFO nova.compute.manager [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Took 17.62 seconds to build instance.
[  725.345830] env[65478]: WARNING neutronclient.v2_0.client [req-94ac9235-5170-4c97-93ad-896b43e349a9 req-cc1ab129-009f-4182-92fd-9536213ab0e4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  725.379952] env[65478]: DEBUG oslo_vmware.api [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011477, 'name': Rename_Task, 'duration_secs': 0.204491} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  725.379952] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  725.380189] env[65478]: DEBUG oslo_vmware.service [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-a4e31530-2941-4544-bb63-269f40aea8fb {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  725.387260] env[65478]: DEBUG oslo_vmware.api [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Waiting for the task: (returnval){
[  725.387260] env[65478]:    value = "task-6011478"
[  725.387260] env[65478]:    _type = "Task"
[  725.387260] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  725.395729] env[65478]: DEBUG oslo_vmware.api [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011478, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  725.413121] env[65478]: DEBUG nova.compute.utils [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  725.414605] env[65478]: DEBUG nova.compute.manager [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Not allocating networking since 'none' was specified. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2039}}
[  725.443750] env[65478]: INFO nova.compute.manager [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Took 21.20 seconds to build instance.
[  725.486299] env[65478]: DEBUG oslo_concurrency.lockutils [req-29f84c71-3e4f-40e1-89ae-270dcf3fa699 req-723b44fd-2bdb-4c62-ac11-1270302ecc17 service nova] Releasing lock "refresh_cache-7507f1f3-c896-492c-9e9b-ebbd47b7c629" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  725.585266] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9acd9447-9b7b-492d-ac5b-3023fed57641 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Lock "7507f1f3-c896-492c-9e9b-ebbd47b7c629" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.955s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  725.699063] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c58529cd-b3c6-4f21-8c4b-03a06eeda2f5 tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Lock "06b7de0a-c338-44b8-97e7-c80281067528" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.136s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  725.887700] env[65478]: DEBUG nova.network.neutron [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Successfully updated port: 09df3109-08b1-49d4-8a44-1f111fb53582 {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  725.908488] env[65478]: DEBUG oslo_vmware.api [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011478, 'name': PowerOnVM_Task} progress is 1%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  725.920406] env[65478]: DEBUG nova.compute.manager [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  725.947025] env[65478]: DEBUG oslo_concurrency.lockutils [None req-5eba0a41-6ebc-46be-a321-3ca99b8ee203 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Lock "f19f4a44-cae7-4ce1-ae57-a6155c93ed54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.715s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  725.968054] env[65478]: WARNING neutronclient.v2_0.client [req-94ac9235-5170-4c97-93ad-896b43e349a9 req-cc1ab129-009f-4182-92fd-9536213ab0e4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  726.141144] env[65478]: DEBUG oslo_vmware.service [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1ca33783-5b20-4d2c-ad6e-69e187c8476a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  726.151660] env[65478]: DEBUG oslo_vmware.service [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-622f1501-bee9-4373-a49e-2c36bd136dc6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  726.199648] env[65478]: DEBUG oslo_vmware.service [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-df2557d5-ff57-42cc-9327-5b1f3ee57780 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  726.204197] env[65478]: DEBUG nova.network.neutron [req-94ac9235-5170-4c97-93ad-896b43e349a9 req-cc1ab129-009f-4182-92fd-9536213ab0e4 service nova] [instance: 230cc05f-433e-4510-947f-35466335662d] Updated VIF entry in instance network info cache for port 985b51bf-6e77-4d08-af82-c5fd27868326. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  726.204581] env[65478]: DEBUG nova.network.neutron [req-94ac9235-5170-4c97-93ad-896b43e349a9 req-cc1ab129-009f-4182-92fd-9536213ab0e4 service nova] [instance: 230cc05f-433e-4510-947f-35466335662d] Updating instance_info_cache with network_info: [{"id": "985b51bf-6e77-4d08-af82-c5fd27868326", "address": "fa:16:3e:23:32:ce", "network": {"id": "2c986fc6-30f7-4e87-b843-cd125149d427", "bridge": "br-int", "label": "tempest-ImagesOneServerNegativeTestJSON-213645312-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "0d8c4a555eaa458ea33089c2385346b7", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "8f40f5c4-c146-449c-884d-6f884dcf2acf", "external-id": "nsx-vlan-transportzone-240", "segmentation_id": 240, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap985b51bf-6e", "ovs_interfaceid": "985b51bf-6e77-4d08-af82-c5fd27868326", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  726.209105] env[65478]: DEBUG oslo_vmware.service [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4cb19b1c-d124-4cb8-b656-ca5d3a81f445 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  726.223570] env[65478]: DEBUG nova.compute.provider_tree [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  726.397262] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Acquiring lock "refresh_cache-78246782-d2a2-4819-8924-51764ffe05aa" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  726.397262] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Acquired lock "refresh_cache-78246782-d2a2-4819-8924-51764ffe05aa" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  726.397262] env[65478]: DEBUG nova.network.neutron [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  726.404558] env[65478]: DEBUG oslo_vmware.api [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011478, 'name': PowerOnVM_Task} progress is 64%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  726.710477] env[65478]: DEBUG oslo_concurrency.lockutils [req-94ac9235-5170-4c97-93ad-896b43e349a9 req-cc1ab129-009f-4182-92fd-9536213ab0e4 service nova] Releasing lock "refresh_cache-230cc05f-433e-4510-947f-35466335662d" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  726.727566] env[65478]: DEBUG nova.scheduler.client.report [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  726.906866] env[65478]: DEBUG oslo_vmware.api [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011478, 'name': PowerOnVM_Task} progress is 75%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  726.936486] env[65478]: DEBUG nova.compute.manager [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  726.971369] env[65478]: DEBUG nova.virt.hardware [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  726.971538] env[65478]: DEBUG nova.virt.hardware [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  726.971692] env[65478]: DEBUG nova.virt.hardware [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  726.972147] env[65478]: DEBUG nova.virt.hardware [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  726.972147] env[65478]: DEBUG nova.virt.hardware [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  726.972147] env[65478]: DEBUG nova.virt.hardware [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  726.972302] env[65478]: DEBUG nova.virt.hardware [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  726.972391] env[65478]: DEBUG nova.virt.hardware [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  726.972534] env[65478]: DEBUG nova.virt.hardware [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  726.972692] env[65478]: DEBUG nova.virt.hardware [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  726.973411] env[65478]: DEBUG nova.virt.hardware [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  726.974138] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-59b1ee1a-6483-46f7-b336-c40ef3b72fb3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  726.982135] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-5cf946f1-b6ee-4f28-8e12-67fb450e9f3a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  727.008124] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Instance VIF info [] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  727.017198] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Creating folder: Project (e0af9ab496e74446aa5277e87125709a). Parent ref: group-v1161186. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  727.020026] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-308e03f2-0746-426c-9c32-e8c0f4abcbe6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  727.022320] env[65478]: DEBUG nova.network.neutron [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  727.028051] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Created folder: Project (e0af9ab496e74446aa5277e87125709a) in parent group-v1161186.
[  727.028216] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Creating folder: Instances. Parent ref: group-v1161205. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  727.028462] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-f10535d9-2726-4858-985c-0c557761c50b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  727.039103] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Created folder: Instances in parent group-v1161205.
[  727.039685] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  727.039982] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 95525483-b7db-427e-87b5-3f946972a250] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  727.041069] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-6f885ffe-b0fe-4519-885d-d8d96c361c59 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  727.065804] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  727.065804] env[65478]:    value = "task-6011481"
[  727.065804] env[65478]:    _type = "Task"
[  727.065804] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  727.074460] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011481, 'name': CreateVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  727.212303] env[65478]: WARNING neutronclient.v2_0.client [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  727.232861] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.327s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  727.234266] env[65478]: DEBUG oslo_concurrency.lockutils [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.597s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  727.236019] env[65478]: DEBUG nova.compute.manager [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  727.238752] env[65478]: INFO nova.compute.claims [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  727.406402] env[65478]: DEBUG oslo_vmware.api [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011478, 'name': PowerOnVM_Task, 'duration_secs': 1.754947} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  727.406829] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  727.407443] env[65478]: INFO nova.compute.manager [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Took 11.86 seconds to spawn the instance on the hypervisor.
[  727.407702] env[65478]: DEBUG nova.compute.manager [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  727.409215] env[65478]: DEBUG oslo_vmware.service [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3956ccab-95b9-442a-a705-b35748dfd6c3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  727.466912] env[65478]: DEBUG oslo_concurrency.lockutils [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Acquiring lock "e4810749-aefd-411e-87c1-5b1b1967538f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  727.467109] env[65478]: DEBUG oslo_concurrency.lockutils [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Lock "e4810749-aefd-411e-87c1-5b1b1967538f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  727.502483] env[65478]: DEBUG nova.network.neutron [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Updating instance_info_cache with network_info: [{"id": "09df3109-08b1-49d4-8a44-1f111fb53582", "address": "fa:16:3e:3f:50:90", "network": {"id": "9610848f-7672-478c-9481-ef6d9198af46", "bridge": "br-int", "label": "tempest-ServersTestFqdnHostnames-142105796-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "81a0ae95d73f4678b203b7db9a0d36a7", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "8c3e2368-4a35-4aa5-9135-23daedbbf9ef", "external-id": "nsx-vlan-transportzone-125", "segmentation_id": 125, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap09df3109-08", "ovs_interfaceid": "09df3109-08b1-49d4-8a44-1f111fb53582", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  727.579942] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011481, 'name': CreateVM_Task, 'duration_secs': 0.32368} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  727.580113] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 95525483-b7db-427e-87b5-3f946972a250] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  727.582135] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-574ac64b-0522-494d-90a6-d9c866e0651e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  727.592375] env[65478]: DEBUG oslo_concurrency.lockutils [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Acquiring lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  727.592375] env[65478]: DEBUG oslo_concurrency.lockutils [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Acquired lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  727.592705] env[65478]: DEBUG oslo_concurrency.lockutils [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Acquired external semaphore "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  727.593008] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-f8a2c735-657c-45b3-ab4f-e2bf04fd3457 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  727.603506] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Waiting for the task: (returnval){
[  727.603506] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]5296f2f0-a80a-8e87-03c6-6578d14bde35"
[  727.603506] env[65478]:    _type = "Task"
[  727.603506] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  727.614882] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5296f2f0-a80a-8e87-03c6-6578d14bde35, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  727.744668] env[65478]: DEBUG nova.compute.utils [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  727.750504] env[65478]: DEBUG nova.compute.manager [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  727.753228] env[65478]: DEBUG nova.network.neutron [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  727.753228] env[65478]: WARNING neutronclient.v2_0.client [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  727.753228] env[65478]: WARNING neutronclient.v2_0.client [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  727.934984] env[65478]: INFO nova.compute.manager [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Took 21.78 seconds to build instance.
[  727.974480] env[65478]: DEBUG nova.compute.manager [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  727.991267] env[65478]: DEBUG nova.policy [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d4862896fff446e91b032ed6c3ebed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f29e7f0a041288f2dc714b6e1f493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  728.008023] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Releasing lock "refresh_cache-78246782-d2a2-4819-8924-51764ffe05aa" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  728.008023] env[65478]: DEBUG nova.compute.manager [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Instance network_info: |[{"id": "09df3109-08b1-49d4-8a44-1f111fb53582", "address": "fa:16:3e:3f:50:90", "network": {"id": "9610848f-7672-478c-9481-ef6d9198af46", "bridge": "br-int", "label": "tempest-ServersTestFqdnHostnames-142105796-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "81a0ae95d73f4678b203b7db9a0d36a7", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "8c3e2368-4a35-4aa5-9135-23daedbbf9ef", "external-id": "nsx-vlan-transportzone-125", "segmentation_id": 125, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap09df3109-08", "ovs_interfaceid": "09df3109-08b1-49d4-8a44-1f111fb53582", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  728.008290] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:3f:50:90', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': '8c3e2368-4a35-4aa5-9135-23daedbbf9ef', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': '09df3109-08b1-49d4-8a44-1f111fb53582', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  728.014483] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Creating folder: Project (81a0ae95d73f4678b203b7db9a0d36a7). Parent ref: group-v1161186. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  728.015228] env[65478]: DEBUG oslo_vmware.service [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-f8572513-fddf-4cc0-b575-d07bb40c6a19 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  728.026081] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Created folder: Project (81a0ae95d73f4678b203b7db9a0d36a7) in parent group-v1161186.
[  728.028169] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Creating folder: Instances. Parent ref: group-v1161208. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  728.028169] env[65478]: DEBUG oslo_vmware.service [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-f626d232-9fc5-429e-9d51-acd6ec4286fa {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  728.035117] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Created folder: Instances in parent group-v1161208.
[  728.035646] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  728.036541] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  728.036889] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-9fe92235-682a-4f1a-87c9-b0e6ffa70d19 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  728.061402] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  728.061402] env[65478]:    value = "task-6011484"
[  728.061402] env[65478]:    _type = "Task"
[  728.061402] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  728.069859] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011484, 'name': CreateVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  728.114285] env[65478]: DEBUG oslo_concurrency.lockutils [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Releasing lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  728.114943] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  728.115198] env[65478]: DEBUG oslo_concurrency.lockutils [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Acquiring lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  728.115326] env[65478]: DEBUG oslo_concurrency.lockutils [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Acquired lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  728.115510] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Creating directory with path [datastore2] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  728.115831] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-a2e428a2-7621-4704-b169-88ebdf50e7f3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  728.125176] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Created directory with path [datastore2] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  728.125331] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Folder [datastore2] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  728.126266] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1bfe4b03-c02a-4bc3-a5ae-e609c651952a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  728.132789] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-ba03dd61-389e-4193-ad0d-b17b8993a4e8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  728.138227] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Waiting for the task: (returnval){
[  728.138227] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52ce82db-d05c-05c8-6bbb-cac249936fef"
[  728.138227] env[65478]:    _type = "Task"
[  728.138227] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  728.146232] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52ce82db-d05c-05c8-6bbb-cac249936fef, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  728.254584] env[65478]: DEBUG nova.compute.manager [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  728.438532] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e7fceb3-28f2-4d23-8fe1-fb5b375b9911 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Lock "230cc05f-433e-4510-947f-35466335662d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.296s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  728.444325] env[65478]: DEBUG nova.network.neutron [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Successfully created port: 608f553d-b692-4674-bf3c-7e763f2fd6cc {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  728.454619] env[65478]: DEBUG oslo_vmware.service [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-2b953cce-478a-4d19-83ba-3a35d4040ebf {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  728.466180] env[65478]: DEBUG oslo_vmware.service [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4bd85c3b-b2fd-418c-aa70-75ef3602ab4a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  728.507713] env[65478]: DEBUG oslo_vmware.service [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4a59e948-0291-476c-bcc9-7df84efca3ea {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  728.514942] env[65478]: DEBUG oslo_concurrency.lockutils [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  728.519700] env[65478]: DEBUG oslo_vmware.service [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-70da30db-ee09-4f5e-93d1-c02e390bbdc1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  728.536086] env[65478]: DEBUG nova.compute.provider_tree [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  728.570976] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011484, 'name': CreateVM_Task} progress is 25%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  728.648403] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Preparing fetch location {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:633}}
[  728.648731] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Creating directory with path [datastore2] vmware_temp/fcdeae28-0830-494f-9c51-de36b68260bb/901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  728.648985] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-f65864d3-5e0a-4912-8105-d26078fe22e8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  728.676017] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Created directory with path [datastore2] vmware_temp/fcdeae28-0830-494f-9c51-de36b68260bb/901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  728.676158] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Fetch image to [datastore2] vmware_temp/fcdeae28-0830-494f-9c51-de36b68260bb/901a05bf-ca6f-4e54-a6ec-7c357eec1043/tmp-sparse.vmdk {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:635}}
[  728.676253] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Downloading image file data 901a05bf-ca6f-4e54-a6ec-7c357eec1043 to [datastore2] vmware_temp/fcdeae28-0830-494f-9c51-de36b68260bb/901a05bf-ca6f-4e54-a6ec-7c357eec1043/tmp-sparse.vmdk on the data store datastore2 {{(pid=65478) _fetch_image_as_file /opt/stack/nova/nova/virt/vmwareapi/vmops.py:399}}
[  728.677158] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-78cbae05-aaf4-4931-a573-1a23c699948a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  728.685731] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8abef1fa-d1b0-47ac-b80c-1d553662673c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  728.695782] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-19e56ff7-58ed-45d5-8129-a5f2591ac06d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  728.731582] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1e1ae085-eccb-4b8f-8992-e60b34d7d933 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  728.737941] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking SessionManager.AcquireGenericServiceTicket with opID=oslo.vmware-a248fbb4-f1dd-4ec6-9b02-b43ee6803f15 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  728.768070] env[65478]: DEBUG nova.virt.vmwareapi.images [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Downloading image file data 901a05bf-ca6f-4e54-a6ec-7c357eec1043 to the data store datastore2 {{(pid=65478) fetch_image /opt/stack/nova/nova/virt/vmwareapi/images.py:245}}
[  728.829855] env[65478]: DEBUG oslo_vmware.rw_handles [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Creating HTTP connection to write to file with size = 21318656 and URL = https://esx7c1n1.openstack.eu-de-1.cloud.sap:443/folder/vmware_temp/fcdeae28-0830-494f-9c51-de36b68260bb/901a05bf-ca6f-4e54-a6ec-7c357eec1043/tmp-sparse.vmdk?dcPath=ha-datacenter&dsName=datastore2. {{(pid=65478) _create_write_connection /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:122}}
[  728.886694] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.virt.vmwareapi.images.image_transfer.<locals>.<lambda>' sleeping for 60.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[  729.038978] env[65478]: DEBUG nova.scheduler.client.report [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  729.073077] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011484, 'name': CreateVM_Task, 'duration_secs': 0.674847} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  729.073775] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  729.074654] env[65478]: WARNING neutronclient.v2_0.client [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  729.075180] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Acquiring lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  729.075394] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Acquired lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  729.075825] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Acquired external semaphore "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  729.076210] env[65478]: DEBUG oslo_vmware.service [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-e4f39273-9690-47a2-b4f1-448098a0abf8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  729.081116] env[65478]: DEBUG oslo_vmware.api [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Waiting for the task: (returnval){
[  729.081116] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]5224641c-f2e1-2e78-46e7-f1ed2afabe40"
[  729.081116] env[65478]:    _type = "Task"
[  729.081116] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  729.089886] env[65478]: DEBUG oslo_vmware.api [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5224641c-f2e1-2e78-46e7-f1ed2afabe40, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  729.265500] env[65478]: DEBUG nova.compute.manager [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  729.295253] env[65478]: DEBUG nova.virt.hardware [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  729.295685] env[65478]: DEBUG nova.virt.hardware [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  729.296019] env[65478]: DEBUG nova.virt.hardware [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  729.296277] env[65478]: DEBUG nova.virt.hardware [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  729.296470] env[65478]: DEBUG nova.virt.hardware [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  729.296658] env[65478]: DEBUG nova.virt.hardware [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  729.297024] env[65478]: DEBUG nova.virt.hardware [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  729.297892] env[65478]: DEBUG nova.virt.hardware [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  729.297892] env[65478]: DEBUG nova.virt.hardware [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  729.297892] env[65478]: DEBUG nova.virt.hardware [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  729.297892] env[65478]: DEBUG nova.virt.hardware [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  729.299151] env[65478]: DEBUG oslo_vmware.service [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4bd1a29a-d061-4519-825f-58cda33b67f4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  729.309173] env[65478]: DEBUG oslo_vmware.service [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-57b927b2-b768-4b06-815b-ba90ae6c13d2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  729.544561] env[65478]: DEBUG oslo_concurrency.lockutils [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.311s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  729.546141] env[65478]: DEBUG oslo_concurrency.lockutils [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.030s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  729.549396] env[65478]: DEBUG nova.compute.manager [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  729.552499] env[65478]: INFO nova.compute.claims [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  729.592457] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Releasing lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  729.592457] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  729.592457] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Acquiring lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  729.945659] env[65478]: DEBUG oslo_vmware.rw_handles [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Completed reading data from the image iterator. {{(pid=65478) read /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:765}}
[  729.945659] env[65478]: DEBUG oslo_vmware.rw_handles [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Closing write handle for https://esx7c1n1.openstack.eu-de-1.cloud.sap:443/folder/vmware_temp/fcdeae28-0830-494f-9c51-de36b68260bb/901a05bf-ca6f-4e54-a6ec-7c357eec1043/tmp-sparse.vmdk?dcPath=ha-datacenter&dsName=datastore2. {{(pid=65478) close /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:281}}
[  730.037854] env[65478]: DEBUG nova.virt.vmwareapi.images [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Downloaded image file data 901a05bf-ca6f-4e54-a6ec-7c357eec1043 to vmware_temp/fcdeae28-0830-494f-9c51-de36b68260bb/901a05bf-ca6f-4e54-a6ec-7c357eec1043/tmp-sparse.vmdk on the data store datastore2 {{(pid=65478) fetch_image /opt/stack/nova/nova/virt/vmwareapi/images.py:258}}
[  730.039268] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Caching image {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:638}}
[  730.041704] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Copying Virtual Disk [datastore2] vmware_temp/fcdeae28-0830-494f-9c51-de36b68260bb/901a05bf-ca6f-4e54-a6ec-7c357eec1043/tmp-sparse.vmdk to [datastore2] vmware_temp/fcdeae28-0830-494f-9c51-de36b68260bb/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  730.041704] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-95d7598f-96ea-4b83-b829-cc31090fad4a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  730.047429] env[65478]: DEBUG nova.compute.manager [req-cedfc3fe-9837-404b-bc78-4ed0b91b348f req-8dc77854-4b44-439a-8195-1bc89a2a53f6 service nova] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Received event network-vif-plugged-09df3109-08b1-49d4-8a44-1f111fb53582 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  730.048761] env[65478]: DEBUG oslo_concurrency.lockutils [req-cedfc3fe-9837-404b-bc78-4ed0b91b348f req-8dc77854-4b44-439a-8195-1bc89a2a53f6 service nova] Acquiring lock "78246782-d2a2-4819-8924-51764ffe05aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  730.049101] env[65478]: DEBUG oslo_concurrency.lockutils [req-cedfc3fe-9837-404b-bc78-4ed0b91b348f req-8dc77854-4b44-439a-8195-1bc89a2a53f6 service nova] Lock "78246782-d2a2-4819-8924-51764ffe05aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  730.049280] env[65478]: DEBUG oslo_concurrency.lockutils [req-cedfc3fe-9837-404b-bc78-4ed0b91b348f req-8dc77854-4b44-439a-8195-1bc89a2a53f6 service nova] Lock "78246782-d2a2-4819-8924-51764ffe05aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  730.051118] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Waiting for the task: (returnval){
[  730.051118] env[65478]:    value = "task-6011485"
[  730.051118] env[65478]:    _type = "Task"
[  730.051118] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  730.054773] env[65478]: DEBUG nova.compute.manager [req-cedfc3fe-9837-404b-bc78-4ed0b91b348f req-8dc77854-4b44-439a-8195-1bc89a2a53f6 service nova] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] No waiting events found dispatching network-vif-plugged-09df3109-08b1-49d4-8a44-1f111fb53582 {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  730.055213] env[65478]: WARNING nova.compute.manager [req-cedfc3fe-9837-404b-bc78-4ed0b91b348f req-8dc77854-4b44-439a-8195-1bc89a2a53f6 service nova] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Received unexpected event network-vif-plugged-09df3109-08b1-49d4-8a44-1f111fb53582 for instance with vm_state building and task_state spawning.
[  730.055583] env[65478]: DEBUG nova.compute.manager [req-cedfc3fe-9837-404b-bc78-4ed0b91b348f req-8dc77854-4b44-439a-8195-1bc89a2a53f6 service nova] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Received event network-changed-09df3109-08b1-49d4-8a44-1f111fb53582 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  730.055698] env[65478]: DEBUG nova.compute.manager [req-cedfc3fe-9837-404b-bc78-4ed0b91b348f req-8dc77854-4b44-439a-8195-1bc89a2a53f6 service nova] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Refreshing instance network info cache due to event network-changed-09df3109-08b1-49d4-8a44-1f111fb53582. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  730.056189] env[65478]: DEBUG oslo_concurrency.lockutils [req-cedfc3fe-9837-404b-bc78-4ed0b91b348f req-8dc77854-4b44-439a-8195-1bc89a2a53f6 service nova] Acquiring lock "refresh_cache-78246782-d2a2-4819-8924-51764ffe05aa" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  730.056696] env[65478]: DEBUG oslo_concurrency.lockutils [req-cedfc3fe-9837-404b-bc78-4ed0b91b348f req-8dc77854-4b44-439a-8195-1bc89a2a53f6 service nova] Acquired lock "refresh_cache-78246782-d2a2-4819-8924-51764ffe05aa" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  730.059641] env[65478]: DEBUG nova.network.neutron [req-cedfc3fe-9837-404b-bc78-4ed0b91b348f req-8dc77854-4b44-439a-8195-1bc89a2a53f6 service nova] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Refreshing network info cache for port 09df3109-08b1-49d4-8a44-1f111fb53582 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  730.072601] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011485, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  730.077480] env[65478]: DEBUG nova.compute.utils [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  730.081536] env[65478]: DEBUG nova.compute.manager [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  730.082892] env[65478]: DEBUG nova.network.neutron [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  730.083329] env[65478]: WARNING neutronclient.v2_0.client [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  730.083608] env[65478]: WARNING neutronclient.v2_0.client [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  730.191764] env[65478]: DEBUG nova.network.neutron [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Successfully updated port: 608f553d-b692-4674-bf3c-7e763f2fd6cc {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  730.238652] env[65478]: DEBUG nova.policy [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aef58c886c5646b9bfdde63265a0a474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183f1111bd4a4c13a354835aa7266cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  730.298428] env[65478]: DEBUG nova.compute.manager [None req-f673800a-460e-4350-a024-fecba363febf tempest-ServerDiagnosticsTest-903725422 tempest-ServerDiagnosticsTest-903725422-project-admin] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  730.300088] env[65478]: DEBUG oslo_vmware.service [None req-f673800a-460e-4350-a024-fecba363febf tempest-ServerDiagnosticsTest-903725422 tempest-ServerDiagnosticsTest-903725422-project-admin] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f547b61a-861e-4bde-8e05-667389c6b034 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  730.310260] env[65478]: INFO nova.compute.manager [None req-f673800a-460e-4350-a024-fecba363febf tempest-ServerDiagnosticsTest-903725422 tempest-ServerDiagnosticsTest-903725422-project-admin] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Retrieving diagnostics
[  730.311189] env[65478]: DEBUG oslo_vmware.service [None req-f673800a-460e-4350-a024-fecba363febf tempest-ServerDiagnosticsTest-903725422 tempest-ServerDiagnosticsTest-903725422-project-admin] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1f02b34e-a64a-4c9a-ad9b-394e72e0ff58 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  730.350477] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Acquiring lock "6a23cbd2-7031-484c-809e-436397029c7d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  730.350767] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Lock "6a23cbd2-7031-484c-809e-436397029c7d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  730.561510] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011485, 'name': CopyVirtualDisk_Task} progress is 100%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  730.576920] env[65478]: WARNING neutronclient.v2_0.client [req-cedfc3fe-9837-404b-bc78-4ed0b91b348f req-8dc77854-4b44-439a-8195-1bc89a2a53f6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  730.584168] env[65478]: DEBUG nova.compute.manager [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  730.687232] env[65478]: DEBUG nova.network.neutron [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Successfully created port: 320b5203-7ff1-4f52-a15b-995d50391e39 {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  730.698730] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Acquiring lock "refresh_cache-c444ace8-9651-4df8-8604-982300643449" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  730.700873] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Acquired lock "refresh_cache-c444ace8-9651-4df8-8604-982300643449" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  730.700873] env[65478]: DEBUG nova.network.neutron [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  730.807536] env[65478]: DEBUG oslo_vmware.service [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-640faeba-bae0-4b50-9465-7236dd877a3e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  730.824395] env[65478]: DEBUG oslo_vmware.service [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-bf144b8d-f32c-40dc-8a4b-6ae8298a76d4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  730.857444] env[65478]: DEBUG nova.compute.manager [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  730.860508] env[65478]: DEBUG oslo_vmware.service [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-92d00f75-3f73-4598-8a13-fb7524128b58 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  730.869033] env[65478]: DEBUG oslo_vmware.service [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8637aee8-41cb-4ec6-a6c0-f96b82d9815d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  730.887675] env[65478]: DEBUG nova.compute.provider_tree [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  731.063978] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011485, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.730092} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  731.064424] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Copied Virtual Disk [datastore2] vmware_temp/fcdeae28-0830-494f-9c51-de36b68260bb/901a05bf-ca6f-4e54-a6ec-7c357eec1043/tmp-sparse.vmdk to [datastore2] vmware_temp/fcdeae28-0830-494f-9c51-de36b68260bb/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  731.064424] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Deleting the datastore file [datastore2] vmware_temp/fcdeae28-0830-494f-9c51-de36b68260bb/901a05bf-ca6f-4e54-a6ec-7c357eec1043/tmp-sparse.vmdk {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  731.064696] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-f523327b-4c6c-45e9-9945-ceaad84f74df {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  731.071859] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Waiting for the task: (returnval){
[  731.071859] env[65478]:    value = "task-6011486"
[  731.071859] env[65478]:    _type = "Task"
[  731.071859] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  731.087713] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011486, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  731.385634] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  731.392820] env[65478]: DEBUG nova.scheduler.client.report [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  731.463356] env[65478]: DEBUG oslo_concurrency.lockutils [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Acquiring lock "7507f1f3-c896-492c-9e9b-ebbd47b7c629" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  731.463356] env[65478]: DEBUG oslo_concurrency.lockutils [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Lock "7507f1f3-c896-492c-9e9b-ebbd47b7c629" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  731.463356] env[65478]: DEBUG oslo_concurrency.lockutils [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Acquiring lock "7507f1f3-c896-492c-9e9b-ebbd47b7c629-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  731.463356] env[65478]: DEBUG oslo_concurrency.lockutils [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Lock "7507f1f3-c896-492c-9e9b-ebbd47b7c629-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  731.464027] env[65478]: DEBUG oslo_concurrency.lockutils [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Lock "7507f1f3-c896-492c-9e9b-ebbd47b7c629-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  731.464373] env[65478]: INFO nova.compute.manager [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Terminating instance
[  731.582778] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011486, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.02512} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  731.583063] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  731.583487] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Moving file from [datastore2] vmware_temp/fcdeae28-0830-494f-9c51-de36b68260bb/901a05bf-ca6f-4e54-a6ec-7c357eec1043 to [datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043. {{(pid=65478) file_move /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:334}}
[  731.583839] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking FileManager.MoveDatastoreFile_Task with opID=oslo.vmware-b2a26d45-3d07-4b0b-8d26-acb2a0975ad0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  731.591109] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Waiting for the task: (returnval){
[  731.591109] env[65478]:    value = "task-6011487"
[  731.591109] env[65478]:    _type = "Task"
[  731.591109] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  731.600362] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011487, 'name': MoveDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  731.601850] env[65478]: DEBUG nova.compute.manager [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  731.627223] env[65478]: DEBUG nova.virt.hardware [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  731.627434] env[65478]: DEBUG nova.virt.hardware [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  731.627547] env[65478]: DEBUG nova.virt.hardware [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  731.627685] env[65478]: DEBUG nova.virt.hardware [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  731.627789] env[65478]: DEBUG nova.virt.hardware [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  731.627895] env[65478]: DEBUG nova.virt.hardware [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  731.628076] env[65478]: DEBUG nova.virt.hardware [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  731.628310] env[65478]: DEBUG nova.virt.hardware [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  731.628310] env[65478]: DEBUG nova.virt.hardware [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  731.628440] env[65478]: DEBUG nova.virt.hardware [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  731.628550] env[65478]: DEBUG nova.virt.hardware [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  731.629512] env[65478]: DEBUG oslo_vmware.service [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-771bd8eb-e3ef-4ff6-8a9b-fc8c56c8b9c1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  731.637112] env[65478]: DEBUG oslo_vmware.service [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4f755cf5-0189-4139-a19d-5f75b689b8b4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  731.896183] env[65478]: DEBUG oslo_concurrency.lockutils [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.351s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  731.897025] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.511s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  731.899297] env[65478]: DEBUG nova.compute.manager [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  731.902276] env[65478]: INFO nova.compute.claims [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  731.968541] env[65478]: DEBUG nova.compute.manager [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[  731.968722] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  731.969883] env[65478]: DEBUG oslo_vmware.service [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-cbfbf315-c377-4857-af3b-f53f088a73c2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  731.978237] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  731.978498] env[65478]: DEBUG oslo_vmware.service [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-762c8108-58a3-4f4c-8fd2-d4a34a43bd11 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  731.983598] env[65478]: DEBUG nova.network.neutron [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  731.987107] env[65478]: DEBUG oslo_vmware.api [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Waiting for the task: (returnval){
[  731.987107] env[65478]:    value = "task-6011488"
[  731.987107] env[65478]:    _type = "Task"
[  731.987107] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  731.997884] env[65478]: DEBUG oslo_vmware.api [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Task: {'id': task-6011488, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  732.104774] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011487, 'name': MoveDatastoreFile_Task, 'duration_secs': 0.029433} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  732.104774] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] File moved {{(pid=65478) file_move /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:346}}
[  732.105134] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Cleaning up location [datastore2] vmware_temp/fcdeae28-0830-494f-9c51-de36b68260bb {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:640}}
[  732.105134] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Deleting the datastore file [datastore2] vmware_temp/fcdeae28-0830-494f-9c51-de36b68260bb {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  732.105310] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-2b917499-c3a7-4f9f-afb4-c91aca872f0d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  732.111515] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Waiting for the task: (returnval){
[  732.111515] env[65478]:    value = "task-6011489"
[  732.111515] env[65478]:    _type = "Task"
[  732.111515] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  732.124158] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011489, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  732.392400] env[65478]: WARNING neutronclient.v2_0.client [req-cedfc3fe-9837-404b-bc78-4ed0b91b348f req-8dc77854-4b44-439a-8195-1bc89a2a53f6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  732.408775] env[65478]: DEBUG nova.compute.utils [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  732.410952] env[65478]: DEBUG nova.compute.manager [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  732.411179] env[65478]: DEBUG nova.network.neutron [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  732.411672] env[65478]: WARNING neutronclient.v2_0.client [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  732.412077] env[65478]: WARNING neutronclient.v2_0.client [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  732.428373] env[65478]: DEBUG nova.network.neutron [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Successfully updated port: 320b5203-7ff1-4f52-a15b-995d50391e39 {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  732.499818] env[65478]: DEBUG oslo_vmware.api [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Task: {'id': task-6011488, 'name': PowerOffVM_Task, 'duration_secs': 0.239742} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  732.500069] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  732.500465] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  732.500465] env[65478]: DEBUG oslo_vmware.service [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-e430acef-ce0d-423b-8077-7a75b33e1c01 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  732.549630] env[65478]: DEBUG nova.policy [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f45e171c3634090a50e7968b63fe17b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b6f91cedac41a6aeb3e367dace092b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  732.557205] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  732.557372] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Deleting contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  732.557507] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Deleting the datastore file [datastore1] 7507f1f3-c896-492c-9e9b-ebbd47b7c629 {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  732.557760] env[65478]: DEBUG oslo_vmware.service [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-2e0cf2f5-447c-47ad-a559-3bed9ea4789f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  732.566567] env[65478]: DEBUG oslo_vmware.api [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Waiting for the task: (returnval){
[  732.566567] env[65478]:    value = "task-6011491"
[  732.566567] env[65478]:    _type = "Task"
[  732.566567] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  732.575107] env[65478]: DEBUG oslo_vmware.api [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Task: {'id': task-6011491, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  732.577606] env[65478]: WARNING neutronclient.v2_0.client [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  732.622823] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011489, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.024663} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  732.623064] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  732.624063] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-7c41123a-4bc2-4b73-99ec-6816db37e389 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  732.630301] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Waiting for the task: (returnval){
[  732.630301] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]5223d116-e5ea-537d-6157-d1da1f6db66e"
[  732.630301] env[65478]:    _type = "Task"
[  732.630301] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  732.639254] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5223d116-e5ea-537d-6157-d1da1f6db66e, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  732.646201] env[65478]: DEBUG nova.network.neutron [req-cedfc3fe-9837-404b-bc78-4ed0b91b348f req-8dc77854-4b44-439a-8195-1bc89a2a53f6 service nova] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Updated VIF entry in instance network info cache for port 09df3109-08b1-49d4-8a44-1f111fb53582. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  732.646512] env[65478]: DEBUG nova.network.neutron [req-cedfc3fe-9837-404b-bc78-4ed0b91b348f req-8dc77854-4b44-439a-8195-1bc89a2a53f6 service nova] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Updating instance_info_cache with network_info: [{"id": "09df3109-08b1-49d4-8a44-1f111fb53582", "address": "fa:16:3e:3f:50:90", "network": {"id": "9610848f-7672-478c-9481-ef6d9198af46", "bridge": "br-int", "label": "tempest-ServersTestFqdnHostnames-142105796-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "81a0ae95d73f4678b203b7db9a0d36a7", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "8c3e2368-4a35-4aa5-9135-23daedbbf9ef", "external-id": "nsx-vlan-transportzone-125", "segmentation_id": 125, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap09df3109-08", "ovs_interfaceid": "09df3109-08b1-49d4-8a44-1f111fb53582", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  732.914440] env[65478]: DEBUG nova.compute.manager [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  732.931662] env[65478]: DEBUG oslo_concurrency.lockutils [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Acquiring lock "refresh_cache-98b2d40a-0c59-4540-b60e-17e5206dea42" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  732.931922] env[65478]: DEBUG oslo_concurrency.lockutils [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Acquired lock "refresh_cache-98b2d40a-0c59-4540-b60e-17e5206dea42" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  732.932025] env[65478]: DEBUG nova.network.neutron [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  733.078027] env[65478]: DEBUG oslo_vmware.api [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Task: {'id': task-6011491, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.144628} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  733.078384] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  733.079304] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Deleted contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  733.079304] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  733.079304] env[65478]: INFO nova.compute.manager [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Took 1.11 seconds to destroy the instance on the hypervisor.
[  733.080107] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  733.080394] env[65478]: DEBUG nova.compute.manager [-] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[  733.080521] env[65478]: DEBUG nova.network.neutron [-] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[  733.080802] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  733.131789] env[65478]: DEBUG oslo_vmware.service [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6ad6060f-41be-4ba6-8727-578aa5ed4a81 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  733.140341] env[65478]: DEBUG nova.network.neutron [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Successfully created port: 77d4d422-ea65-4577-ae8a-77615259cfb1 {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  733.155775] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5223d116-e5ea-537d-6157-d1da1f6db66e, 'name': SearchDatastore_Task, 'duration_secs': 0.016873} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  733.156245] env[65478]: DEBUG oslo_vmware.service [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a01a178f-d772-4c9d-8d14-8464a0e1055f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  733.160953] env[65478]: DEBUG oslo_concurrency.lockutils [req-cedfc3fe-9837-404b-bc78-4ed0b91b348f req-8dc77854-4b44-439a-8195-1bc89a2a53f6 service nova] Releasing lock "refresh_cache-78246782-d2a2-4819-8924-51764ffe05aa" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  733.160953] env[65478]: DEBUG oslo_concurrency.lockutils [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Releasing lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  733.160953] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Copying Virtual Disk [datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore2] 95525483-b7db-427e-87b5-3f946972a250/95525483-b7db-427e-87b5-3f946972a250.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  733.161691] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Acquired lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  733.161898] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-bd2e499f-433d-4791-b179-d740840e4dcb {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  733.165229] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Creating directory with path [datastore2] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  733.168614] env[65478]: DEBUG oslo_vmware.service [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-83f1bdb5-6e71-45fd-afc0-3c2aaa61811a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  733.187160] env[65478]: DEBUG nova.network.neutron [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Updating instance_info_cache with network_info: [{"id": "608f553d-b692-4674-bf3c-7e763f2fd6cc", "address": "fa:16:3e:1f:7a:71", "network": {"id": "8419dcc5-ccb7-4667-a5ee-3f07016ddecd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "eb20b7ec77e847179c9940510a8b48bf", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "ec3f9e71-839a-429d-b211-d3dfc98ca4f6", "external-id": "nsx-vlan-transportzone-5", "segmentation_id": 5, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap608f553d-b6", "ovs_interfaceid": "608f553d-b692-4674-bf3c-7e763f2fd6cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  733.205482] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Created directory with path [datastore2] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  733.205665] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Folder [datastore2] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  733.206444] env[65478]: DEBUG oslo_vmware.service [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-e67d93c5-b279-478c-94f6-78731779828b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  733.210488] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Waiting for the task: (returnval){
[  733.210488] env[65478]:    value = "task-6011492"
[  733.210488] env[65478]:    _type = "Task"
[  733.210488] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  733.215895] env[65478]: DEBUG oslo_vmware.service [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-35cb8b1f-bf67-4651-ab44-c626696b09e2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  733.220915] env[65478]: DEBUG oslo_vmware.api [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Waiting for the task: (returnval){
[  733.220915] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]5207d938-2214-bb56-2e1e-6dc20ba11634"
[  733.220915] env[65478]:    _type = "Task"
[  733.220915] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  733.228760] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011492, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  733.234786] env[65478]: DEBUG oslo_vmware.api [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5207d938-2214-bb56-2e1e-6dc20ba11634, 'name': SearchDatastore_Task, 'duration_secs': 0.009954} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  733.236462] env[65478]: DEBUG oslo_vmware.service [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-fa48ff64-f406-45db-afc1-fff37d206048 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  733.241613] env[65478]: DEBUG oslo_vmware.service [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d2b7490a-8cf0-4a55-a929-b47da26854d0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  733.247845] env[65478]: DEBUG oslo_vmware.api [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Waiting for the task: (returnval){
[  733.247845] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]523d1d2d-8285-1fec-bd6c-40b652c8a92d"
[  733.247845] env[65478]:    _type = "Task"
[  733.247845] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  733.262950] env[65478]: DEBUG oslo_vmware.api [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]523d1d2d-8285-1fec-bd6c-40b652c8a92d, 'name': SearchDatastore_Task, 'duration_secs': 0.010591} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  733.267915] env[65478]: DEBUG nova.compute.provider_tree [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  733.270031] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Releasing lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  733.273307] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Copying Virtual Disk [datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore2] 78246782-d2a2-4819-8924-51764ffe05aa/78246782-d2a2-4819-8924-51764ffe05aa.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  733.273307] env[65478]: DEBUG oslo_vmware.service [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-77873fa6-dfec-44d6-9daf-8ae1d1f78af0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  733.276815] env[65478]: DEBUG oslo_vmware.api [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Waiting for the task: (returnval){
[  733.276815] env[65478]:    value = "task-6011493"
[  733.276815] env[65478]:    _type = "Task"
[  733.276815] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  733.286189] env[65478]: DEBUG oslo_vmware.api [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Task: {'id': task-6011493, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  733.296393] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  733.453969] env[65478]: DEBUG nova.compute.manager [None req-bda9c2a8-11ac-4ae1-9545-661f2604292e tempest-ServerDiagnosticsV248Test-358379843 tempest-ServerDiagnosticsV248Test-358379843-project-admin] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  733.458633] env[65478]: DEBUG oslo_vmware.service [None req-bda9c2a8-11ac-4ae1-9545-661f2604292e tempest-ServerDiagnosticsV248Test-358379843 tempest-ServerDiagnosticsV248Test-358379843-project-admin] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-54123cac-5cfa-4d8b-83f8-169f7e69d2ce {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  733.471739] env[65478]: INFO nova.compute.manager [None req-bda9c2a8-11ac-4ae1-9545-661f2604292e tempest-ServerDiagnosticsV248Test-358379843 tempest-ServerDiagnosticsV248Test-358379843-project-admin] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Retrieving diagnostics
[  733.472807] env[65478]: DEBUG oslo_vmware.service [None req-bda9c2a8-11ac-4ae1-9545-661f2604292e tempest-ServerDiagnosticsV248Test-358379843 tempest-ServerDiagnosticsV248Test-358379843-project-admin] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-547f5883-69d6-4784-8e8f-62d685e7abee {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  733.519063] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Acquiring lock "88cd130c-b811-4789-aea2-964848abdd69" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  733.519063] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Lock "88cd130c-b811-4789-aea2-964848abdd69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  733.571093] env[65478]: DEBUG nova.network.neutron [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  733.688345] env[65478]: WARNING neutronclient.v2_0.client [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  733.711427] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Releasing lock "refresh_cache-c444ace8-9651-4df8-8604-982300643449" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  733.711694] env[65478]: DEBUG nova.compute.manager [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Instance network_info: |[{"id": "608f553d-b692-4674-bf3c-7e763f2fd6cc", "address": "fa:16:3e:1f:7a:71", "network": {"id": "8419dcc5-ccb7-4667-a5ee-3f07016ddecd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "eb20b7ec77e847179c9940510a8b48bf", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "ec3f9e71-839a-429d-b211-d3dfc98ca4f6", "external-id": "nsx-vlan-transportzone-5", "segmentation_id": 5, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap608f553d-b6", "ovs_interfaceid": "608f553d-b692-4674-bf3c-7e763f2fd6cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  733.712273] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:1f:7a:71', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': 'ec3f9e71-839a-429d-b211-d3dfc98ca4f6', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': '608f553d-b692-4674-bf3c-7e763f2fd6cc', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  733.731959] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Creating folder: Project (570f29e7f0a041288f2dc714b6e1f493). Parent ref: group-v1161186. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  733.732468] env[65478]: DEBUG oslo_vmware.service [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-3950f1fc-9aee-44b0-a0e7-2d0770154c77 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  733.740713] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011492, 'name': CopyVirtualDisk_Task} progress is 77%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  733.744038] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Created folder: Project (570f29e7f0a041288f2dc714b6e1f493) in parent group-v1161186.
[  733.744038] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Creating folder: Instances. Parent ref: group-v1161211. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  733.744038] env[65478]: DEBUG oslo_vmware.service [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-b0fbd7b5-fbe6-4143-9625-dd21c899aeb3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  733.752624] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Created folder: Instances in parent group-v1161211.
[  733.753647] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  733.753940] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: c444ace8-9651-4df8-8604-982300643449] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  733.754246] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-12c385b1-fe6d-4ce3-823c-0d2d4ee0647f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  733.774272] env[65478]: DEBUG nova.scheduler.client.report [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  733.783017] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  733.783017] env[65478]:    value = "task-6011496"
[  733.783017] env[65478]:    _type = "Task"
[  733.783017] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  733.794080] env[65478]: DEBUG nova.network.neutron [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Updating instance_info_cache with network_info: [{"id": "320b5203-7ff1-4f52-a15b-995d50391e39", "address": "fa:16:3e:c7:10:4c", "network": {"id": "4a1b5d4b-4c82-4116-be7c-20e7f0f647cd", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1744686632-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "183f1111bd4a4c13a354835aa7266cc2", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "c2d3bf80-d60a-4b53-a00a-1381de6d4a12", "external-id": "nsx-vlan-transportzone-982", "segmentation_id": 982, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap320b5203-7f", "ovs_interfaceid": "320b5203-7ff1-4f52-a15b-995d50391e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  733.811864] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011496, 'name': CreateVM_Task} progress is 10%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  733.819954] env[65478]: DEBUG oslo_vmware.api [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Task: {'id': task-6011493, 'name': CopyVirtualDisk_Task} progress is 4%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  733.927833] env[65478]: DEBUG nova.compute.manager [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  733.964309] env[65478]: DEBUG nova.virt.hardware [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  733.965169] env[65478]: DEBUG nova.virt.hardware [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  733.965169] env[65478]: DEBUG nova.virt.hardware [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  733.965266] env[65478]: DEBUG nova.virt.hardware [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  733.965764] env[65478]: DEBUG nova.virt.hardware [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  733.965764] env[65478]: DEBUG nova.virt.hardware [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  733.965764] env[65478]: DEBUG nova.virt.hardware [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  733.966096] env[65478]: DEBUG nova.virt.hardware [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  733.966096] env[65478]: DEBUG nova.virt.hardware [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  733.966762] env[65478]: DEBUG nova.virt.hardware [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  733.966762] env[65478]: DEBUG nova.virt.hardware [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  733.967663] env[65478]: DEBUG oslo_vmware.service [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-93c93485-dd1a-481f-ab79-d1d01b7c5da6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  733.978748] env[65478]: DEBUG oslo_vmware.service [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f040cba1-67bd-4378-9bd8-df3f0e96a6c6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  734.020658] env[65478]: DEBUG nova.compute.manager [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  734.027166] env[65478]: DEBUG nova.network.neutron [-] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  734.232604] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011492, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.62875} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  734.232894] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Copied Virtual Disk [datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore2] 95525483-b7db-427e-87b5-3f946972a250/95525483-b7db-427e-87b5-3f946972a250.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  734.233020] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  734.233304] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-8a2905a5-bc19-4fd5-8b9b-531494f98da0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  734.239270] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Waiting for the task: (returnval){
[  734.239270] env[65478]:    value = "task-6011497"
[  734.239270] env[65478]:    _type = "Task"
[  734.239270] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  734.247927] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011497, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  734.302372] env[65478]: DEBUG oslo_vmware.api [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Task: {'id': task-6011493, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.864529} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  734.306938] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Copied Virtual Disk [datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore2] 78246782-d2a2-4819-8924-51764ffe05aa/78246782-d2a2-4819-8924-51764ffe05aa.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  734.308412] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011496, 'name': CreateVM_Task, 'duration_secs': 0.446416} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  734.308523] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: c444ace8-9651-4df8-8604-982300643449] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  734.309263] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  734.309638] env[65478]: WARNING neutronclient.v2_0.client [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  734.309987] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Acquiring lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  734.310198] env[65478]: DEBUG oslo_vmware.service [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-34eeff92-4bb7-47ea-a326-842c77fa62e9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  734.312766] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Acquired lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  734.313103] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Acquired external semaphore "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  734.313385] env[65478]: DEBUG oslo_vmware.service [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-3f3e470f-5902-43a7-8e5a-6725cc3ffa7a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  734.316544] env[65478]: DEBUG oslo_vmware.api [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Waiting for the task: (returnval){
[  734.316544] env[65478]:    value = "task-6011498"
[  734.316544] env[65478]:    _type = "Task"
[  734.316544] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  734.323916] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.427s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  734.327125] env[65478]: DEBUG oslo_concurrency.lockutils [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Releasing lock "refresh_cache-98b2d40a-0c59-4540-b60e-17e5206dea42" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  734.330010] env[65478]: DEBUG nova.compute.manager [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  734.333199] env[65478]: DEBUG oslo_vmware.api [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Waiting for the task: (returnval){
[  734.333199] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52d342b4-7870-c5d0-70b7-a53de2554c7b"
[  734.333199] env[65478]:    _type = "Task"
[  734.333199] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  734.336610] env[65478]: DEBUG oslo_vmware.api [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Task: {'id': task-6011498, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  734.340072] env[65478]: DEBUG nova.compute.manager [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Instance network_info: |[{"id": "320b5203-7ff1-4f52-a15b-995d50391e39", "address": "fa:16:3e:c7:10:4c", "network": {"id": "4a1b5d4b-4c82-4116-be7c-20e7f0f647cd", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1744686632-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "183f1111bd4a4c13a354835aa7266cc2", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "c2d3bf80-d60a-4b53-a00a-1381de6d4a12", "external-id": "nsx-vlan-transportzone-982", "segmentation_id": 982, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap320b5203-7f", "ovs_interfaceid": "320b5203-7ff1-4f52-a15b-995d50391e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  734.342357] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:c7:10:4c', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': 'c2d3bf80-d60a-4b53-a00a-1381de6d4a12', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': '320b5203-7ff1-4f52-a15b-995d50391e39', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  734.354022] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Creating folder: Project (183f1111bd4a4c13a354835aa7266cc2). Parent ref: group-v1161186. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  734.354772] env[65478]: DEBUG oslo_vmware.service [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-d18c6b01-3616-4b67-b4cb-b40d5583b13f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  734.365791] env[65478]: DEBUG oslo_vmware.api [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52d342b4-7870-c5d0-70b7-a53de2554c7b, 'name': SearchDatastore_Task, 'duration_secs': 0.009531} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  734.365791] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Releasing lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  734.365791] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  734.365993] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Acquiring lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  734.365993] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Acquired lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  734.366129] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Creating directory with path [datastore2] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  734.366794] env[65478]: DEBUG oslo_vmware.service [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-c7b268c8-3826-4ec1-82ff-dd13cd2505cd {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  734.372546] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Created folder: Project (183f1111bd4a4c13a354835aa7266cc2) in parent group-v1161186.
[  734.373232] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Creating folder: Instances. Parent ref: group-v1161214. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  734.373391] env[65478]: DEBUG oslo_vmware.service [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-8eef2841-1018-4a57-ada7-d578f3e41043 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  734.376808] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Created directory with path [datastore2] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  734.376942] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Folder [datastore2] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  734.378091] env[65478]: DEBUG oslo_vmware.service [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-ba948d28-e23a-40ce-a02f-b72c57c9f9f2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  734.382726] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Created folder: Instances in parent group-v1161214.
[  734.383897] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  734.385185] env[65478]: DEBUG oslo_vmware.api [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Waiting for the task: (returnval){
[  734.385185] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52742365-21ca-f52a-c941-92ff572fc027"
[  734.385185] env[65478]:    _type = "Task"
[  734.385185] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  734.388483] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  734.388937] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-b466edd4-2b8b-478f-821a-4eb288f87b54 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  734.403542] env[65478]: DEBUG oslo_vmware.api [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52742365-21ca-f52a-c941-92ff572fc027, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  734.414215] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  734.414215] env[65478]:    value = "task-6011501"
[  734.414215] env[65478]:    _type = "Task"
[  734.414215] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  734.423599] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011501, 'name': CreateVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  734.533911] env[65478]: INFO nova.compute.manager [-] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Took 1.45 seconds to deallocate network for instance.
[  734.559708] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  734.559708] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  734.562210] env[65478]: INFO nova.compute.claims [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  734.626706] env[65478]: DEBUG nova.compute.manager [req-16499499-2e13-427b-b6b6-3d9591332d44 req-6f2ed4a8-10ec-4f0b-9572-d753a1ac040b service nova] [instance: c444ace8-9651-4df8-8604-982300643449] Received event network-vif-plugged-608f553d-b692-4674-bf3c-7e763f2fd6cc {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  734.626936] env[65478]: DEBUG oslo_concurrency.lockutils [req-16499499-2e13-427b-b6b6-3d9591332d44 req-6f2ed4a8-10ec-4f0b-9572-d753a1ac040b service nova] Acquiring lock "c444ace8-9651-4df8-8604-982300643449-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  734.627098] env[65478]: DEBUG oslo_concurrency.lockutils [req-16499499-2e13-427b-b6b6-3d9591332d44 req-6f2ed4a8-10ec-4f0b-9572-d753a1ac040b service nova] Lock "c444ace8-9651-4df8-8604-982300643449-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  734.627658] env[65478]: DEBUG oslo_concurrency.lockutils [req-16499499-2e13-427b-b6b6-3d9591332d44 req-6f2ed4a8-10ec-4f0b-9572-d753a1ac040b service nova] Lock "c444ace8-9651-4df8-8604-982300643449-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  734.627658] env[65478]: DEBUG nova.compute.manager [req-16499499-2e13-427b-b6b6-3d9591332d44 req-6f2ed4a8-10ec-4f0b-9572-d753a1ac040b service nova] [instance: c444ace8-9651-4df8-8604-982300643449] No waiting events found dispatching network-vif-plugged-608f553d-b692-4674-bf3c-7e763f2fd6cc {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  734.627658] env[65478]: WARNING nova.compute.manager [req-16499499-2e13-427b-b6b6-3d9591332d44 req-6f2ed4a8-10ec-4f0b-9572-d753a1ac040b service nova] [instance: c444ace8-9651-4df8-8604-982300643449] Received unexpected event network-vif-plugged-608f553d-b692-4674-bf3c-7e763f2fd6cc for instance with vm_state building and task_state spawning.
[  734.628649] env[65478]: DEBUG nova.compute.manager [req-16499499-2e13-427b-b6b6-3d9591332d44 req-6f2ed4a8-10ec-4f0b-9572-d753a1ac040b service nova] [instance: c444ace8-9651-4df8-8604-982300643449] Received event network-changed-608f553d-b692-4674-bf3c-7e763f2fd6cc {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  734.628649] env[65478]: DEBUG nova.compute.manager [req-16499499-2e13-427b-b6b6-3d9591332d44 req-6f2ed4a8-10ec-4f0b-9572-d753a1ac040b service nova] [instance: c444ace8-9651-4df8-8604-982300643449] Refreshing instance network info cache due to event network-changed-608f553d-b692-4674-bf3c-7e763f2fd6cc. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  734.628760] env[65478]: DEBUG oslo_concurrency.lockutils [req-16499499-2e13-427b-b6b6-3d9591332d44 req-6f2ed4a8-10ec-4f0b-9572-d753a1ac040b service nova] Acquiring lock "refresh_cache-c444ace8-9651-4df8-8604-982300643449" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  734.629256] env[65478]: DEBUG oslo_concurrency.lockutils [req-16499499-2e13-427b-b6b6-3d9591332d44 req-6f2ed4a8-10ec-4f0b-9572-d753a1ac040b service nova] Acquired lock "refresh_cache-c444ace8-9651-4df8-8604-982300643449" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  734.629256] env[65478]: DEBUG nova.network.neutron [req-16499499-2e13-427b-b6b6-3d9591332d44 req-6f2ed4a8-10ec-4f0b-9572-d753a1ac040b service nova] [instance: c444ace8-9651-4df8-8604-982300643449] Refreshing network info cache for port 608f553d-b692-4674-bf3c-7e763f2fd6cc {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  734.711038] env[65478]: DEBUG oslo_concurrency.lockutils [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Acquiring lock "f19f4a44-cae7-4ce1-ae57-a6155c93ed54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  734.711305] env[65478]: DEBUG oslo_concurrency.lockutils [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Lock "f19f4a44-cae7-4ce1-ae57-a6155c93ed54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  734.711501] env[65478]: DEBUG oslo_concurrency.lockutils [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Acquiring lock "f19f4a44-cae7-4ce1-ae57-a6155c93ed54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  734.711640] env[65478]: DEBUG oslo_concurrency.lockutils [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Lock "f19f4a44-cae7-4ce1-ae57-a6155c93ed54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  734.711767] env[65478]: DEBUG oslo_concurrency.lockutils [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Lock "f19f4a44-cae7-4ce1-ae57-a6155c93ed54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  734.714081] env[65478]: INFO nova.compute.manager [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Terminating instance
[  734.749456] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011497, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.068081} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  734.749680] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  734.750536] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f15c49b7-9b9e-4d57-bea5-1fffdde31580 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  734.777825] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Reconfiguring VM instance instance-00000008 to attach disk [datastore2] 95525483-b7db-427e-87b5-3f946972a250/95525483-b7db-427e-87b5-3f946972a250.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  734.778392] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-8988476e-4ebe-4813-9c32-107e3b303a5e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  734.802083] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Waiting for the task: (returnval){
[  734.802083] env[65478]:    value = "task-6011502"
[  734.802083] env[65478]:    _type = "Task"
[  734.802083] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  734.811346] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011502, 'name': ReconfigVM_Task} progress is 5%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  734.829485] env[65478]: DEBUG oslo_vmware.api [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Task: {'id': task-6011498, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.06733} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  734.829747] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  734.830628] env[65478]: DEBUG oslo_vmware.service [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0e287f34-9d84-4540-82d2-0fbd8ad774e8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  734.847101] env[65478]: DEBUG nova.compute.utils [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  734.859596] env[65478]: DEBUG nova.compute.manager [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  734.860039] env[65478]: DEBUG nova.network.neutron [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  734.863894] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Reconfiguring VM instance instance-00000007 to attach disk [datastore2] 78246782-d2a2-4819-8924-51764ffe05aa/78246782-d2a2-4819-8924-51764ffe05aa.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  734.864458] env[65478]: WARNING neutronclient.v2_0.client [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  734.864748] env[65478]: DEBUG oslo_vmware.service [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-ffdd0eec-339f-4f72-9ba5-300c53fc6319 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  734.870570] env[65478]: WARNING neutronclient.v2_0.client [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  734.896116] env[65478]: DEBUG oslo_vmware.api [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52742365-21ca-f52a-c941-92ff572fc027, 'name': SearchDatastore_Task, 'duration_secs': 0.009003} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  734.898400] env[65478]: DEBUG oslo_vmware.api [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Waiting for the task: (returnval){
[  734.898400] env[65478]:    value = "task-6011503"
[  734.898400] env[65478]:    _type = "Task"
[  734.898400] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  734.902373] env[65478]: DEBUG oslo_vmware.service [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-41e562b3-b1ad-466b-bfc1-06c502d04693 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  734.909516] env[65478]: DEBUG oslo_vmware.api [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Task: {'id': task-6011503, 'name': ReconfigVM_Task} progress is 10%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  734.912840] env[65478]: DEBUG oslo_vmware.api [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Waiting for the task: (returnval){
[  734.912840] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]5287785c-e88a-b0ff-6bc2-618cbf0b2b41"
[  734.912840] env[65478]:    _type = "Task"
[  734.912840] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  734.927590] env[65478]: DEBUG oslo_vmware.api [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5287785c-e88a-b0ff-6bc2-618cbf0b2b41, 'name': SearchDatastore_Task, 'duration_secs': 0.010783} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  734.930975] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011501, 'name': CreateVM_Task} progress is 99%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  734.931226] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Releasing lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  734.931465] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Copying Virtual Disk [datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore2] c444ace8-9651-4df8-8604-982300643449/c444ace8-9651-4df8-8604-982300643449.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  734.931740] env[65478]: DEBUG oslo_vmware.service [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-5b10b700-411f-4e1a-93f3-0a588ede89fc {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  734.939345] env[65478]: DEBUG oslo_vmware.api [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Waiting for the task: (returnval){
[  734.939345] env[65478]:    value = "task-6011504"
[  734.939345] env[65478]:    _type = "Task"
[  734.939345] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  734.949406] env[65478]: DEBUG oslo_vmware.api [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Task: {'id': task-6011504, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  735.047696] env[65478]: DEBUG oslo_concurrency.lockutils [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  735.132293] env[65478]: WARNING neutronclient.v2_0.client [req-16499499-2e13-427b-b6b6-3d9591332d44 req-6f2ed4a8-10ec-4f0b-9572-d753a1ac040b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  735.218206] env[65478]: DEBUG nova.compute.manager [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[  735.219220] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  735.220093] env[65478]: DEBUG nova.policy [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c75f81d818c4f599cd1365e21d24498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7482d231bd7d499c9c6ea1c2957612ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  735.222167] env[65478]: DEBUG oslo_vmware.service [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1a6a639b-bcd9-46ad-a8b2-9c4f65ebd0ad {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  735.232806] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  735.233347] env[65478]: DEBUG oslo_vmware.service [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-22c920ee-aa97-4d62-8a9e-3df0b3bbe5ea {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  735.241248] env[65478]: DEBUG oslo_vmware.api [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Waiting for the task: (returnval){
[  735.241248] env[65478]:    value = "task-6011505"
[  735.241248] env[65478]:    _type = "Task"
[  735.241248] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  735.251335] env[65478]: DEBUG oslo_vmware.api [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Task: {'id': task-6011505, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  735.319007] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011502, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  735.319853] env[65478]: DEBUG nova.network.neutron [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Successfully updated port: 77d4d422-ea65-4577-ae8a-77615259cfb1 {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  735.363794] env[65478]: DEBUG nova.compute.manager [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  735.413880] env[65478]: DEBUG oslo_vmware.api [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Task: {'id': task-6011503, 'name': ReconfigVM_Task, 'duration_secs': 0.382432} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  735.414326] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Reconfigured VM instance instance-00000007 to attach disk [datastore2] 78246782-d2a2-4819-8924-51764ffe05aa/78246782-d2a2-4819-8924-51764ffe05aa.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  735.415477] env[65478]: DEBUG oslo_vmware.service [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-0d8a24e8-fad1-4e0a-a3c1-140f3542d55f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  735.428349] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011501, 'name': CreateVM_Task, 'duration_secs': 0.586445} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  735.428564] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  735.429890] env[65478]: WARNING neutronclient.v2_0.client [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  735.430294] env[65478]: DEBUG oslo_concurrency.lockutils [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Acquiring lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  735.430441] env[65478]: DEBUG oslo_concurrency.lockutils [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Acquired lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  735.432401] env[65478]: DEBUG oslo_vmware.api [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Waiting for the task: (returnval){
[  735.432401] env[65478]:    value = "task-6011506"
[  735.432401] env[65478]:    _type = "Task"
[  735.432401] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  735.451259] env[65478]: DEBUG oslo_concurrency.lockutils [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Acquired external semaphore "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  735.451259] env[65478]: DEBUG oslo_vmware.service [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-e5ea6685-e30b-4c6a-abd8-22a497811d9c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  735.457735] env[65478]: DEBUG oslo_vmware.api [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Task: {'id': task-6011506, 'name': Rename_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  735.465274] env[65478]: DEBUG oslo_vmware.api [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Task: {'id': task-6011504, 'name': CopyVirtualDisk_Task} progress is 51%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  735.465782] env[65478]: DEBUG oslo_vmware.api [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Waiting for the task: (returnval){
[  735.465782] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52f4401e-c73c-d626-7c56-fbd01783881e"
[  735.465782] env[65478]:    _type = "Task"
[  735.465782] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  735.480240] env[65478]: DEBUG oslo_vmware.api [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52f4401e-c73c-d626-7c56-fbd01783881e, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  735.764782] env[65478]: DEBUG oslo_vmware.api [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Task: {'id': task-6011505, 'name': PowerOffVM_Task, 'duration_secs': 0.332439} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  735.764916] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  735.764990] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  735.767018] env[65478]: DEBUG oslo_vmware.service [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-a582bfb7-77ed-44e4-9240-940816cc7746 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  735.786367] env[65478]: DEBUG oslo_vmware.service [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ed7cdcec-b4ad-4683-94ca-eb4c0f3957d0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  735.799027] env[65478]: DEBUG oslo_vmware.service [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d78d87da-dc71-41f1-8851-b2d1a78f3df8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  735.816762] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011502, 'name': ReconfigVM_Task, 'duration_secs': 0.681907} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  735.816989] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Reconfigured VM instance instance-00000008 to attach disk [datastore2] 95525483-b7db-427e-87b5-3f946972a250/95525483-b7db-427e-87b5-3f946972a250.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  735.818029] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-26d151ed-8618-42a2-8f4e-b619fec656ff {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  735.826326] env[65478]: DEBUG oslo_concurrency.lockutils [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Acquiring lock "refresh_cache-e4810749-aefd-411e-87c1-5b1b1967538f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  735.833421] env[65478]: DEBUG oslo_concurrency.lockutils [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Acquired lock "refresh_cache-e4810749-aefd-411e-87c1-5b1b1967538f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  735.833421] env[65478]: DEBUG nova.network.neutron [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  735.840273] env[65478]: DEBUG nova.network.neutron [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Successfully created port: 0d1a1269-dc87-4884-8918-e8ebaaa034f7 {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  735.867082] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  735.867694] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Deleting contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  735.867847] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Deleting the datastore file [datastore1] f19f4a44-cae7-4ce1-ae57-a6155c93ed54 {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  735.868202] env[65478]: DEBUG oslo_vmware.service [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-a91d4125-2b3b-48c9-b26c-6a8179d120f8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  735.895538] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Waiting for the task: (returnval){
[  735.895538] env[65478]:    value = "task-6011508"
[  735.895538] env[65478]:    _type = "Task"
[  735.895538] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  735.907900] env[65478]: DEBUG oslo_vmware.service [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-352357e5-9219-4765-9761-d9ff762b036c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  735.913256] env[65478]: DEBUG oslo_vmware.api [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Waiting for the task: (returnval){
[  735.913256] env[65478]:    value = "task-6011509"
[  735.913256] env[65478]:    _type = "Task"
[  735.913256] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  735.930358] env[65478]: DEBUG oslo_vmware.service [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-cac473f6-106d-48bc-a9a8-911e1c0b1ae8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  735.940790] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011508, 'name': Rename_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  735.960698] env[65478]: DEBUG oslo_vmware.api [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Task: {'id': task-6011506, 'name': Rename_Task, 'duration_secs': 0.24177} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  735.978743] env[65478]: DEBUG oslo_vmware.api [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Task: {'id': task-6011509, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  735.988033] env[65478]: DEBUG nova.compute.provider_tree [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  735.992627] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  735.995665] env[65478]: DEBUG oslo_vmware.api [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52f4401e-c73c-d626-7c56-fbd01783881e, 'name': SearchDatastore_Task, 'duration_secs': 0.06186} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  735.996503] env[65478]: DEBUG oslo_vmware.api [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Task: {'id': task-6011504, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.611075} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  735.997138] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Copied Virtual Disk [datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore2] c444ace8-9651-4df8-8604-982300643449/c444ace8-9651-4df8-8604-982300643449.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  735.997281] env[65478]: DEBUG oslo_concurrency.lockutils [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Releasing lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  735.997651] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  735.998122] env[65478]: DEBUG oslo_vmware.service [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-5e220b19-5247-4dcd-96b3-e450d5589af1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  736.001487] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  736.002195] env[65478]: DEBUG oslo_vmware.service [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-494cab4a-49fd-46e5-85c3-c2bed6188888 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  736.006417] env[65478]: DEBUG oslo_concurrency.lockutils [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Acquiring lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  736.006594] env[65478]: DEBUG oslo_concurrency.lockutils [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Acquired lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  736.006882] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Creating directory with path [datastore2] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  736.007267] env[65478]: DEBUG oslo_vmware.service [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-2cf44616-167d-494a-846c-490c2fe613e3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  736.019667] env[65478]: DEBUG oslo_vmware.api [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Waiting for the task: (returnval){
[  736.019667] env[65478]:    value = "task-6011510"
[  736.019667] env[65478]:    _type = "Task"
[  736.019667] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  736.027911] env[65478]: DEBUG oslo_vmware.api [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Waiting for the task: (returnval){
[  736.027911] env[65478]:    value = "task-6011511"
[  736.027911] env[65478]:    _type = "Task"
[  736.027911] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  736.040476] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Created directory with path [datastore2] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  736.040677] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Folder [datastore2] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  736.041749] env[65478]: DEBUG oslo_vmware.service [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-cde7fb24-9f38-4817-8114-75f3f7736a56 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  736.051585] env[65478]: DEBUG oslo_vmware.api [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Waiting for the task: (returnval){
[  736.051585] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]524c6d07-33be-d065-b80e-992a13415576"
[  736.051585] env[65478]:    _type = "Task"
[  736.051585] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  736.061281] env[65478]: DEBUG oslo_vmware.api [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Task: {'id': task-6011510, 'name': PowerOnVM_Task} progress is 66%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  736.067166] env[65478]: DEBUG oslo_vmware.api [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]524c6d07-33be-d065-b80e-992a13415576, 'name': SearchDatastore_Task, 'duration_secs': 0.009421} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  736.071377] env[65478]: DEBUG oslo_vmware.api [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Task: {'id': task-6011511, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  736.071695] env[65478]: DEBUG oslo_vmware.service [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-12b2fe22-0e40-4b7b-9316-1b392a660e2e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  736.078041] env[65478]: DEBUG oslo_vmware.api [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Waiting for the task: (returnval){
[  736.078041] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c7d989-63a8-b04f-0186-4f9c8f206bf1"
[  736.078041] env[65478]:    _type = "Task"
[  736.078041] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  736.088846] env[65478]: DEBUG oslo_vmware.api [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c7d989-63a8-b04f-0186-4f9c8f206bf1, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  736.284511] env[65478]: DEBUG nova.compute.manager [req-05c25bba-0c33-4575-8fb1-2ab0fafdba3b req-fdb901b2-2cc4-480e-b94f-73eed9db8c06 service nova] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Received event network-vif-deleted-b521acaa-20d3-47d2-83e5-bf46598dcc68 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  736.399334] env[65478]: DEBUG nova.compute.manager [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  736.410182] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011508, 'name': Rename_Task, 'duration_secs': 0.155398} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  736.410408] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  736.410647] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-673846cf-8ef9-4352-8313-20fc6ea23aa1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  736.416361] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Waiting for the task: (returnval){
[  736.416361] env[65478]:    value = "task-6011512"
[  736.416361] env[65478]:    _type = "Task"
[  736.416361] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  736.425966] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011512, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  736.429579] env[65478]: DEBUG nova.virt.hardware [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  736.429777] env[65478]: DEBUG nova.virt.hardware [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  736.429893] env[65478]: DEBUG nova.virt.hardware [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  736.435218] env[65478]: DEBUG nova.virt.hardware [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  736.435341] env[65478]: DEBUG nova.virt.hardware [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  736.435447] env[65478]: DEBUG nova.virt.hardware [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  736.435625] env[65478]: DEBUG nova.virt.hardware [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  736.435757] env[65478]: DEBUG nova.virt.hardware [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  736.435896] env[65478]: DEBUG nova.virt.hardware [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  736.436038] env[65478]: DEBUG nova.virt.hardware [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  736.436173] env[65478]: DEBUG nova.virt.hardware [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  736.441258] env[65478]: DEBUG oslo_vmware.api [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Task: {'id': task-6011509, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.185553} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  736.441496] env[65478]: DEBUG oslo_vmware.service [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-309a346c-68ba-4439-b3cb-4abab93d2f0e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  736.443928] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  736.444137] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Deleted contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  736.444276] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  736.444423] env[65478]: INFO nova.compute.manager [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Took 1.23 seconds to destroy the instance on the hypervisor.
[  736.445980] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  736.446258] env[65478]: DEBUG nova.compute.manager [-] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[  736.446620] env[65478]: DEBUG nova.network.neutron [-] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[  736.446929] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  736.452554] env[65478]: DEBUG oslo_vmware.service [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-46edeb51-6550-43a6-820a-8e46f52bc7cd {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  736.501021] env[65478]: DEBUG nova.scheduler.client.report [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  736.531509] env[65478]: DEBUG oslo_vmware.api [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Task: {'id': task-6011510, 'name': PowerOnVM_Task} progress is 89%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  736.543302] env[65478]: DEBUG oslo_vmware.api [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Task: {'id': task-6011511, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.205137} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  736.544964] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  736.545144] env[65478]: DEBUG oslo_vmware.service [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-2f2f6a9d-a8e9-4247-9de0-b47a1ba1e33f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  736.570179] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Reconfiguring VM instance instance-00000009 to attach disk [datastore2] c444ace8-9651-4df8-8604-982300643449/c444ace8-9651-4df8-8604-982300643449.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  736.570512] env[65478]: DEBUG oslo_vmware.service [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-e590db8c-3b69-4aa1-93b4-59dbedc02bd6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  736.595308] env[65478]: DEBUG oslo_vmware.api [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c7d989-63a8-b04f-0186-4f9c8f206bf1, 'name': SearchDatastore_Task, 'duration_secs': 0.013085} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  736.595308] env[65478]: DEBUG oslo_concurrency.lockutils [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Releasing lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  736.595308] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Copying Virtual Disk [datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore2] 98b2d40a-0c59-4540-b60e-17e5206dea42/98b2d40a-0c59-4540-b60e-17e5206dea42.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  736.595698] env[65478]: DEBUG oslo_vmware.service [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-ac91f56e-c602-4cd2-acb3-095fb748a075 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  736.599407] env[65478]: DEBUG oslo_vmware.api [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Waiting for the task: (returnval){
[  736.599407] env[65478]:    value = "task-6011513"
[  736.599407] env[65478]:    _type = "Task"
[  736.599407] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  736.608347] env[65478]: DEBUG oslo_vmware.api [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Waiting for the task: (returnval){
[  736.608347] env[65478]:    value = "task-6011514"
[  736.608347] env[65478]:    _type = "Task"
[  736.608347] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  736.618594] env[65478]: DEBUG oslo_vmware.api [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Task: {'id': task-6011513, 'name': ReconfigVM_Task} progress is 10%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  736.624086] env[65478]: DEBUG oslo_vmware.api [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Task: {'id': task-6011514, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  736.749836] env[65478]: WARNING neutronclient.v2_0.client [req-16499499-2e13-427b-b6b6-3d9591332d44 req-6f2ed4a8-10ec-4f0b-9572-d753a1ac040b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  736.780000] env[65478]: DEBUG nova.network.neutron [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  736.875105] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  736.928101] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011512, 'name': PowerOnVM_Task} progress is 1%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  737.008638] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.448s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  737.008638] env[65478]: DEBUG nova.compute.manager [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  737.011655] env[65478]: DEBUG oslo_concurrency.lockutils [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.965s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  737.012714] env[65478]: DEBUG nova.objects.instance [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Lazy-loading 'resources' on Instance uuid 7507f1f3-c896-492c-9e9b-ebbd47b7c629 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  737.031121] env[65478]: DEBUG oslo_vmware.api [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Task: {'id': task-6011510, 'name': PowerOnVM_Task, 'duration_secs': 0.864955} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  737.031121] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  737.031121] env[65478]: INFO nova.compute.manager [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Took 12.46 seconds to spawn the instance on the hypervisor.
[  737.031121] env[65478]: DEBUG nova.compute.manager [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  737.032291] env[65478]: DEBUG oslo_vmware.service [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a708ee2a-0ffa-4ea9-a6f8-edce33d78a56 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  737.111148] env[65478]: DEBUG oslo_vmware.api [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Task: {'id': task-6011513, 'name': ReconfigVM_Task, 'duration_secs': 0.429017} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  737.111740] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Reconfigured VM instance instance-00000009 to attach disk [datastore2] c444ace8-9651-4df8-8604-982300643449/c444ace8-9651-4df8-8604-982300643449.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  737.117097] env[65478]: DEBUG oslo_vmware.service [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-b9df8c2f-cb9f-4026-9ac9-f937f3c14303 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  737.126027] env[65478]: DEBUG oslo_vmware.api [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Task: {'id': task-6011514, 'name': CopyVirtualDisk_Task} progress is 77%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  737.128482] env[65478]: DEBUG oslo_vmware.api [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Waiting for the task: (returnval){
[  737.128482] env[65478]:    value = "task-6011515"
[  737.128482] env[65478]:    _type = "Task"
[  737.128482] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  737.140348] env[65478]: DEBUG oslo_vmware.api [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Task: {'id': task-6011515, 'name': Rename_Task} progress is 10%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  737.427820] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011512, 'name': PowerOnVM_Task} progress is 82%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  737.444672] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Acquiring lock "4f7fb80a-cb05-4bd5-bb10-380d95b2e892" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  737.445655] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Lock "4f7fb80a-cb05-4bd5-bb10-380d95b2e892" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  737.504500] env[65478]: DEBUG nova.network.neutron [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Successfully updated port: 0d1a1269-dc87-4884-8918-e8ebaaa034f7 {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  737.515392] env[65478]: DEBUG nova.compute.utils [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  737.558125] env[65478]: INFO nova.compute.manager [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Took 25.24 seconds to build instance.
[  737.624669] env[65478]: DEBUG oslo_vmware.api [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Task: {'id': task-6011514, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.561033} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  737.624908] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Copied Virtual Disk [datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore2] 98b2d40a-0c59-4540-b60e-17e5206dea42/98b2d40a-0c59-4540-b60e-17e5206dea42.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  737.625105] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  737.625381] env[65478]: DEBUG oslo_vmware.service [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-8c6fd54e-ae60-4de0-a974-dca34ef81e4c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  737.634950] env[65478]: DEBUG oslo_vmware.api [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Waiting for the task: (returnval){
[  737.634950] env[65478]:    value = "task-6011516"
[  737.634950] env[65478]:    _type = "Task"
[  737.634950] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  737.645324] env[65478]: DEBUG oslo_vmware.api [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Task: {'id': task-6011515, 'name': Rename_Task, 'duration_secs': 0.234485} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  737.645937] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  737.646218] env[65478]: DEBUG oslo_vmware.service [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-5c5df394-751f-4334-a224-4fc996816852 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  737.651271] env[65478]: DEBUG oslo_vmware.api [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Task: {'id': task-6011516, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  737.658802] env[65478]: DEBUG oslo_vmware.api [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Waiting for the task: (returnval){
[  737.658802] env[65478]:    value = "task-6011517"
[  737.658802] env[65478]:    _type = "Task"
[  737.658802] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  737.669095] env[65478]: DEBUG oslo_vmware.api [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Task: {'id': task-6011517, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  737.799028] env[65478]: DEBUG oslo_vmware.service [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-03d7824e-ef34-45a9-ac74-41925d3b318d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  737.807687] env[65478]: DEBUG oslo_vmware.service [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f74ab07c-835a-46d1-adb6-070e6340e421 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  737.844465] env[65478]: DEBUG nova.network.neutron [req-16499499-2e13-427b-b6b6-3d9591332d44 req-6f2ed4a8-10ec-4f0b-9572-d753a1ac040b service nova] [instance: c444ace8-9651-4df8-8604-982300643449] Updated VIF entry in instance network info cache for port 608f553d-b692-4674-bf3c-7e763f2fd6cc. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  737.850590] env[65478]: DEBUG nova.network.neutron [req-16499499-2e13-427b-b6b6-3d9591332d44 req-6f2ed4a8-10ec-4f0b-9572-d753a1ac040b service nova] [instance: c444ace8-9651-4df8-8604-982300643449] Updating instance_info_cache with network_info: [{"id": "608f553d-b692-4674-bf3c-7e763f2fd6cc", "address": "fa:16:3e:1f:7a:71", "network": {"id": "8419dcc5-ccb7-4667-a5ee-3f07016ddecd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "eb20b7ec77e847179c9940510a8b48bf", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "ec3f9e71-839a-429d-b211-d3dfc98ca4f6", "external-id": "nsx-vlan-transportzone-5", "segmentation_id": 5, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap608f553d-b6", "ovs_interfaceid": "608f553d-b692-4674-bf3c-7e763f2fd6cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  737.853558] env[65478]: DEBUG oslo_vmware.service [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b58857c9-e150-4f68-9161-da0d5bcdd197 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  737.863920] env[65478]: DEBUG oslo_vmware.service [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d556e92d-9a37-489a-9839-1057c30af56b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  737.884012] env[65478]: DEBUG nova.compute.provider_tree [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  737.929505] env[65478]: DEBUG oslo_vmware.api [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011512, 'name': PowerOnVM_Task, 'duration_secs': 1.15343} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  737.930201] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  737.930483] env[65478]: INFO nova.compute.manager [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Took 10.99 seconds to spawn the instance on the hypervisor.
[  737.930742] env[65478]: DEBUG nova.compute.manager [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  737.932175] env[65478]: DEBUG oslo_vmware.service [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-5ad855d6-27dd-42d4-b443-0838e76499e4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  737.949119] env[65478]: DEBUG nova.compute.manager [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  738.007729] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Acquiring lock "refresh_cache-6a23cbd2-7031-484c-809e-436397029c7d" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  738.008254] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Acquired lock "refresh_cache-6a23cbd2-7031-484c-809e-436397029c7d" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  738.008588] env[65478]: DEBUG nova.network.neutron [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  738.023504] env[65478]: DEBUG nova.compute.manager [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  738.064754] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1f0c8fca-ccbb-43e9-913a-222d6d4aa9b7 tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Lock "78246782-d2a2-4819-8924-51764ffe05aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.364s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  738.064754] env[65478]: DEBUG nova.compute.manager [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  738.064754] env[65478]: DEBUG nova.network.neutron [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  738.065557] env[65478]: WARNING neutronclient.v2_0.client [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  738.065557] env[65478]: WARNING neutronclient.v2_0.client [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  738.088426] env[65478]: WARNING neutronclient.v2_0.client [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  738.150365] env[65478]: DEBUG oslo_vmware.api [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Task: {'id': task-6011516, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.237651} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  738.150365] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  738.151544] env[65478]: DEBUG oslo_vmware.service [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-944154ad-2650-4bad-9152-d18f8daa4f47 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  738.184307] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Reconfiguring VM instance instance-0000000a to attach disk [datastore2] 98b2d40a-0c59-4540-b60e-17e5206dea42/98b2d40a-0c59-4540-b60e-17e5206dea42.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  738.185158] env[65478]: DEBUG oslo_vmware.service [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-256e18fa-ac69-4fb0-a9d9-5b6d78c18f9f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  738.209750] env[65478]: DEBUG oslo_vmware.api [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Task: {'id': task-6011517, 'name': PowerOnVM_Task} progress is 66%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  738.213778] env[65478]: DEBUG nova.policy [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6478afb0c13c4cc38812b6cb1ffc550b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd8c4cd35c44466b1991950f28d886b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  738.217086] env[65478]: DEBUG oslo_vmware.api [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Waiting for the task: (returnval){
[  738.217086] env[65478]:    value = "task-6011518"
[  738.217086] env[65478]:    _type = "Task"
[  738.217086] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  738.227718] env[65478]: DEBUG oslo_vmware.api [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Task: {'id': task-6011518, 'name': ReconfigVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  738.305314] env[65478]: DEBUG nova.network.neutron [-] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  738.358661] env[65478]: DEBUG oslo_concurrency.lockutils [req-16499499-2e13-427b-b6b6-3d9591332d44 req-6f2ed4a8-10ec-4f0b-9572-d753a1ac040b service nova] Releasing lock "refresh_cache-c444ace8-9651-4df8-8604-982300643449" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  738.387123] env[65478]: DEBUG nova.scheduler.client.report [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  738.448772] env[65478]: DEBUG nova.network.neutron [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Updating instance_info_cache with network_info: [{"id": "77d4d422-ea65-4577-ae8a-77615259cfb1", "address": "fa:16:3e:52:95:56", "network": {"id": "684d3d46-b7f8-44e4-b8ff-51b0a8c27a1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-600899984-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "88b6f91cedac41a6aeb3e367dace092b", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "5ba07329-1d3e-4ba8-8774-d029262318c4", "external-id": "nsx-vlan-transportzone-534", "segmentation_id": 534, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap77d4d422-ea", "ovs_interfaceid": "77d4d422-ea65-4577-ae8a-77615259cfb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  738.455842] env[65478]: INFO nova.compute.manager [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Took 22.41 seconds to build instance.
[  738.484724] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  738.675472] env[65478]: DEBUG oslo_vmware.api [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Task: {'id': task-6011517, 'name': PowerOnVM_Task} progress is 89%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  738.707446] env[65478]: DEBUG nova.network.neutron [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Successfully created port: 958d3060-f044-4655-8c5e-bd81773ad096 {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  738.728609] env[65478]: DEBUG oslo_vmware.api [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Task: {'id': task-6011518, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  738.807244] env[65478]: INFO nova.compute.manager [-] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Took 2.36 seconds to deallocate network for instance.
[  738.861503] env[65478]: DEBUG nova.network.neutron [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  738.895852] env[65478]: DEBUG oslo_concurrency.lockutils [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.882s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  738.895852] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.411s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  738.897430] env[65478]: INFO nova.compute.claims [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  738.952500] env[65478]: INFO nova.scheduler.client.report [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Deleted allocations for instance 7507f1f3-c896-492c-9e9b-ebbd47b7c629
[  738.958191] env[65478]: DEBUG oslo_concurrency.lockutils [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Releasing lock "refresh_cache-e4810749-aefd-411e-87c1-5b1b1967538f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  738.958191] env[65478]: DEBUG nova.compute.manager [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Instance network_info: |[{"id": "77d4d422-ea65-4577-ae8a-77615259cfb1", "address": "fa:16:3e:52:95:56", "network": {"id": "684d3d46-b7f8-44e4-b8ff-51b0a8c27a1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-600899984-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "88b6f91cedac41a6aeb3e367dace092b", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "5ba07329-1d3e-4ba8-8774-d029262318c4", "external-id": "nsx-vlan-transportzone-534", "segmentation_id": 534, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap77d4d422-ea", "ovs_interfaceid": "77d4d422-ea65-4577-ae8a-77615259cfb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  738.959338] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:52:95:56', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': '5ba07329-1d3e-4ba8-8774-d029262318c4', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': '77d4d422-ea65-4577-ae8a-77615259cfb1', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  738.965042] env[65478]: DEBUG oslo_concurrency.lockutils [None req-67f75cba-a036-4f87-bfb7-0c1eda64e08f tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Lock "95525483-b7db-427e-87b5-3f946972a250" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.938s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  738.970169] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Creating folder: Project (88b6f91cedac41a6aeb3e367dace092b). Parent ref: group-v1161186. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  738.970644] env[65478]: DEBUG oslo_vmware.service [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-8ccdf4dc-555c-4ccf-9540-9e6c40331339 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  738.982945] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Created folder: Project (88b6f91cedac41a6aeb3e367dace092b) in parent group-v1161186.
[  738.982945] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Creating folder: Instances. Parent ref: group-v1161217. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  738.982945] env[65478]: DEBUG oslo_vmware.service [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-407c26dc-6373-4d6c-ac73-87ff7cdbaad3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  738.992698] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Created folder: Instances in parent group-v1161217.
[  738.995876] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  738.996161] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  738.996448] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-c9de0d3c-f4cf-4de8-8b41-71a293053c47 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  739.018063] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  739.018063] env[65478]:    value = "task-6011521"
[  739.018063] env[65478]:    _type = "Task"
[  739.018063] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  739.027861] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011521, 'name': CreateVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  739.038435] env[65478]: DEBUG nova.compute.manager [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  739.091448] env[65478]: DEBUG nova.virt.hardware [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  739.091668] env[65478]: DEBUG nova.virt.hardware [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  739.091914] env[65478]: DEBUG nova.virt.hardware [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  739.092755] env[65478]: DEBUG nova.virt.hardware [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  739.092755] env[65478]: DEBUG nova.virt.hardware [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  739.092755] env[65478]: DEBUG nova.virt.hardware [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  739.092891] env[65478]: DEBUG nova.virt.hardware [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  739.092891] env[65478]: DEBUG nova.virt.hardware [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  739.093061] env[65478]: DEBUG nova.virt.hardware [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  739.093282] env[65478]: DEBUG nova.virt.hardware [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  739.093465] env[65478]: DEBUG nova.virt.hardware [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  739.094531] env[65478]: DEBUG oslo_vmware.service [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e251a89e-eca6-4bc2-863e-527d83787cf5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  739.104659] env[65478]: DEBUG oslo_vmware.service [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4068c78c-cc6d-48b0-8f96-b5d4006efc27 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  739.176567] env[65478]: DEBUG oslo_vmware.api [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Task: {'id': task-6011517, 'name': PowerOnVM_Task, 'duration_secs': 1.175244} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  739.176832] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  739.176994] env[65478]: INFO nova.compute.manager [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Took 9.91 seconds to spawn the instance on the hypervisor.
[  739.177863] env[65478]: DEBUG nova.compute.manager [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  739.178073] env[65478]: DEBUG oslo_vmware.service [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-2ece2c0e-1e4a-4319-a3d4-92d5b709cf5c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  739.228416] env[65478]: DEBUG oslo_vmware.api [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Task: {'id': task-6011518, 'name': ReconfigVM_Task, 'duration_secs': 0.78143} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  739.228750] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Reconfigured VM instance instance-0000000a to attach disk [datastore2] 98b2d40a-0c59-4540-b60e-17e5206dea42/98b2d40a-0c59-4540-b60e-17e5206dea42.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  739.229778] env[65478]: DEBUG oslo_vmware.service [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-4cf710fb-9f4e-48da-a8fa-ef755f5c695e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  739.238599] env[65478]: DEBUG oslo_vmware.api [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Waiting for the task: (returnval){
[  739.238599] env[65478]:    value = "task-6011522"
[  739.238599] env[65478]:    _type = "Task"
[  739.238599] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  739.250553] env[65478]: DEBUG oslo_vmware.api [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Task: {'id': task-6011522, 'name': Rename_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  739.317565] env[65478]: DEBUG oslo_concurrency.lockutils [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  739.464822] env[65478]: DEBUG oslo_concurrency.lockutils [None req-454290e1-3d44-4ed7-aad3-a8b5ceb1158d tempest-DeleteServersAdminTestJSON-540858135 tempest-DeleteServersAdminTestJSON-540858135-project-admin] Lock "7507f1f3-c896-492c-9e9b-ebbd47b7c629" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.003s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  739.532662] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011521, 'name': CreateVM_Task, 'duration_secs': 0.314989} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  739.532840] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  739.534037] env[65478]: WARNING neutronclient.v2_0.client [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  739.534037] env[65478]: DEBUG oslo_concurrency.lockutils [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Acquiring lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  739.534037] env[65478]: DEBUG oslo_concurrency.lockutils [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Acquired lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  739.534240] env[65478]: DEBUG oslo_concurrency.lockutils [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Acquired external semaphore "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  739.534535] env[65478]: DEBUG oslo_vmware.service [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-6ba3a66c-fc7e-40af-8715-aa66055b74fa {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  739.539099] env[65478]: DEBUG oslo_vmware.api [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Waiting for the task: (returnval){
[  739.539099] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52e35e9f-7b09-f27e-3a60-51e145e38e9d"
[  739.539099] env[65478]:    _type = "Task"
[  739.539099] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  739.547181] env[65478]: DEBUG oslo_vmware.api [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52e35e9f-7b09-f27e-3a60-51e145e38e9d, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  739.693524] env[65478]: INFO nova.compute.manager [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Took 20.47 seconds to build instance.
[  739.748687] env[65478]: DEBUG oslo_vmware.api [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Task: {'id': task-6011522, 'name': Rename_Task, 'duration_secs': 0.153101} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  739.749036] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  739.749246] env[65478]: DEBUG oslo_vmware.service [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-704fe640-9816-4bff-aad3-9b0a57d3f854 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  739.755302] env[65478]: DEBUG oslo_vmware.api [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Waiting for the task: (returnval){
[  739.755302] env[65478]:    value = "task-6011523"
[  739.755302] env[65478]:    _type = "Task"
[  739.755302] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  739.759372] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Acquiring lock "79200ab1-07f5-48a8-b2f0-b670852df5a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  739.759596] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Lock "79200ab1-07f5-48a8-b2f0-b670852df5a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  739.759748] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Acquiring lock "79200ab1-07f5-48a8-b2f0-b670852df5a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  739.762933] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Lock "79200ab1-07f5-48a8-b2f0-b670852df5a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  739.763103] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Lock "79200ab1-07f5-48a8-b2f0-b670852df5a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  739.764676] env[65478]: DEBUG oslo_vmware.api [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Task: {'id': task-6011523, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  739.766069] env[65478]: INFO nova.compute.manager [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Terminating instance
[  740.051251] env[65478]: DEBUG oslo_vmware.api [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52e35e9f-7b09-f27e-3a60-51e145e38e9d, 'name': SearchDatastore_Task, 'duration_secs': 0.008885} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  740.053316] env[65478]: DEBUG oslo_concurrency.lockutils [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Releasing lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  740.053316] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  740.053316] env[65478]: DEBUG oslo_concurrency.lockutils [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Acquiring lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  740.053316] env[65478]: DEBUG oslo_concurrency.lockutils [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Acquired lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  740.053835] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Creating directory with path [datastore2] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  740.053835] env[65478]: DEBUG oslo_vmware.service [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-1598eb0d-348e-4bd4-9bc4-5d90752a8913 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  740.062121] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Created directory with path [datastore2] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  740.063488] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Folder [datastore2] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  740.063488] env[65478]: DEBUG oslo_vmware.service [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-5eee0019-8d53-44db-a8ba-9eeadc1a7c1c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  740.070894] env[65478]: DEBUG oslo_vmware.api [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Waiting for the task: (returnval){
[  740.070894] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52a959db-c8c5-0a8e-9438-11905cda1223"
[  740.070894] env[65478]:    _type = "Task"
[  740.070894] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  740.080811] env[65478]: DEBUG oslo_vmware.api [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52a959db-c8c5-0a8e-9438-11905cda1223, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  740.127661] env[65478]: DEBUG oslo_vmware.service [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f2f90134-a5d3-4946-a818-02aee3c7f86d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  740.137661] env[65478]: DEBUG oslo_vmware.service [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-dbdd8925-cae4-4d63-aa55-463cb6645ad0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  740.172909] env[65478]: DEBUG oslo_vmware.service [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9e68f9f5-c02b-469b-89ab-cfb58f4f92af {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  740.182064] env[65478]: DEBUG oslo_vmware.service [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-bac2767b-3806-493f-889b-75c9b4207e1c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  740.198958] env[65478]: DEBUG nova.compute.provider_tree [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  740.200287] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e2ee202c-9aaa-4746-b1ce-ff803e058c8b tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Lock "c444ace8-9651-4df8-8604-982300643449" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  740.267611] env[65478]: DEBUG oslo_vmware.api [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Task: {'id': task-6011523, 'name': PowerOnVM_Task} progress is 66%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  740.269700] env[65478]: DEBUG nova.compute.manager [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[  740.269930] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  740.271174] env[65478]: DEBUG oslo_vmware.service [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ddeda234-f6b7-4b33-af5a-bcbc0361dc10 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  740.278813] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  740.279036] env[65478]: DEBUG oslo_vmware.service [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-44919f23-6545-4b75-a07e-c2b27d095fa4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  740.284823] env[65478]: DEBUG oslo_vmware.api [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Waiting for the task: (returnval){
[  740.284823] env[65478]:    value = "task-6011524"
[  740.284823] env[65478]:    _type = "Task"
[  740.284823] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  740.293537] env[65478]: DEBUG oslo_vmware.api [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Task: {'id': task-6011524, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  740.582868] env[65478]: DEBUG oslo_vmware.api [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52a959db-c8c5-0a8e-9438-11905cda1223, 'name': SearchDatastore_Task, 'duration_secs': 0.009737} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  740.583891] env[65478]: DEBUG oslo_vmware.service [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-110fb2c7-33d8-488a-92e1-135f101067bf {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  740.588995] env[65478]: DEBUG oslo_vmware.api [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Waiting for the task: (returnval){
[  740.588995] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52d4b4a6-b603-77c8-5a35-e99e62b86030"
[  740.588995] env[65478]:    _type = "Task"
[  740.588995] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  740.597757] env[65478]: DEBUG oslo_vmware.api [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52d4b4a6-b603-77c8-5a35-e99e62b86030, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  740.661598] env[65478]: WARNING neutronclient.v2_0.client [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  740.702920] env[65478]: DEBUG nova.scheduler.client.report [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  740.766303] env[65478]: DEBUG oslo_vmware.api [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Task: {'id': task-6011523, 'name': PowerOnVM_Task, 'duration_secs': 0.728788} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  740.766500] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  740.766654] env[65478]: INFO nova.compute.manager [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Took 9.16 seconds to spawn the instance on the hypervisor.
[  740.766789] env[65478]: DEBUG nova.compute.manager [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  740.767830] env[65478]: DEBUG oslo_vmware.service [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-eefe8eea-2bba-4fca-b463-20a9318e53ef {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  740.784374] env[65478]: DEBUG nova.network.neutron [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Successfully updated port: 958d3060-f044-4655-8c5e-bd81773ad096 {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  740.796327] env[65478]: DEBUG oslo_vmware.api [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Task: {'id': task-6011524, 'name': PowerOffVM_Task, 'duration_secs': 0.317185} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  740.796618] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  740.796855] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  740.797496] env[65478]: DEBUG oslo_vmware.service [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-e82d9766-cc16-49a4-88c7-6564d5085a2e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  740.865660] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  740.865821] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Deleting contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  740.865880] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Deleting the datastore file [datastore1] 79200ab1-07f5-48a8-b2f0-b670852df5a0 {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  740.866169] env[65478]: DEBUG oslo_vmware.service [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-d3c7f4e6-c954-4193-95b0-441964130428 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  740.874216] env[65478]: DEBUG oslo_vmware.api [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Waiting for the task: (returnval){
[  740.874216] env[65478]:    value = "task-6011526"
[  740.874216] env[65478]:    _type = "Task"
[  740.874216] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  740.884539] env[65478]: DEBUG oslo_vmware.api [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Task: {'id': task-6011526, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  740.895390] env[65478]: DEBUG nova.network.neutron [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Updating instance_info_cache with network_info: [{"id": "0d1a1269-dc87-4884-8918-e8ebaaa034f7", "address": "fa:16:3e:be:31:73", "network": {"id": "0b606843-0f39-40db-bf5a-f9db85f44b4a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-98949410-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "7482d231bd7d499c9c6ea1c2957612ad", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "37e8d2ee-abfc-42e2-a8fa-ee5447f1f1da", "external-id": "nsx-vlan-transportzone-813", "segmentation_id": 813, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap0d1a1269-dc", "ovs_interfaceid": "0d1a1269-dc87-4884-8918-e8ebaaa034f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  741.099747] env[65478]: DEBUG oslo_vmware.api [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52d4b4a6-b603-77c8-5a35-e99e62b86030, 'name': SearchDatastore_Task, 'duration_secs': 0.027856} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  741.100020] env[65478]: DEBUG oslo_concurrency.lockutils [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Releasing lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  741.100284] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Copying Virtual Disk [datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore2] e4810749-aefd-411e-87c1-5b1b1967538f/e4810749-aefd-411e-87c1-5b1b1967538f.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  741.100586] env[65478]: DEBUG oslo_vmware.service [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-d7974105-4535-4301-bb8c-01b197617726 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  741.107323] env[65478]: DEBUG oslo_vmware.api [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Waiting for the task: (returnval){
[  741.107323] env[65478]:    value = "task-6011527"
[  741.107323] env[65478]:    _type = "Task"
[  741.107323] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  741.117093] env[65478]: DEBUG oslo_vmware.api [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Task: {'id': task-6011527, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  741.206872] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.311s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  741.208165] env[65478]: DEBUG oslo_concurrency.lockutils [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.890s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  741.208436] env[65478]: DEBUG nova.compute.manager [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  741.211206] env[65478]: DEBUG nova.objects.instance [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Lazy-loading 'resources' on Instance uuid f19f4a44-cae7-4ce1-ae57-a6155c93ed54 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  741.287901] env[65478]: INFO nova.compute.manager [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Took 18.70 seconds to build instance.
[  741.289396] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Acquiring lock "refresh_cache-88cd130c-b811-4789-aea2-964848abdd69" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  741.289396] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Acquired lock "refresh_cache-88cd130c-b811-4789-aea2-964848abdd69" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  741.294084] env[65478]: DEBUG nova.network.neutron [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  741.386574] env[65478]: DEBUG oslo_vmware.api [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Task: {'id': task-6011526, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.154605} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  741.386944] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  741.387236] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Deleted contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  741.387516] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  741.387756] env[65478]: INFO nova.compute.manager [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Took 1.12 seconds to destroy the instance on the hypervisor.
[  741.388540] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  741.388801] env[65478]: DEBUG nova.compute.manager [-] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[  741.389037] env[65478]: DEBUG nova.network.neutron [-] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[  741.389310] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  741.398389] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Releasing lock "refresh_cache-6a23cbd2-7031-484c-809e-436397029c7d" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  741.398728] env[65478]: DEBUG nova.compute.manager [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Instance network_info: |[{"id": "0d1a1269-dc87-4884-8918-e8ebaaa034f7", "address": "fa:16:3e:be:31:73", "network": {"id": "0b606843-0f39-40db-bf5a-f9db85f44b4a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-98949410-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "7482d231bd7d499c9c6ea1c2957612ad", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "37e8d2ee-abfc-42e2-a8fa-ee5447f1f1da", "external-id": "nsx-vlan-transportzone-813", "segmentation_id": 813, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap0d1a1269-dc", "ovs_interfaceid": "0d1a1269-dc87-4884-8918-e8ebaaa034f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  741.399256] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:be:31:73', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': '37e8d2ee-abfc-42e2-a8fa-ee5447f1f1da', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': '0d1a1269-dc87-4884-8918-e8ebaaa034f7', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  741.408409] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Creating folder: Project (7482d231bd7d499c9c6ea1c2957612ad). Parent ref: group-v1161186. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  741.408784] env[65478]: DEBUG oslo_vmware.service [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-3fb71473-7000-4f33-8b3d-29f71919c7a5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  741.418225] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Created folder: Project (7482d231bd7d499c9c6ea1c2957612ad) in parent group-v1161186.
[  741.418431] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Creating folder: Instances. Parent ref: group-v1161220. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  741.418691] env[65478]: DEBUG oslo_vmware.service [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-88374403-f571-438a-ad8a-50671d7f5379 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  741.430600] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Created folder: Instances in parent group-v1161220.
[  741.431687] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  741.432077] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  741.432475] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-22fa132e-efcc-49c1-b8e6-4f72b0289701 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  741.458754] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  741.458754] env[65478]:    value = "task-6011530"
[  741.458754] env[65478]:    _type = "Task"
[  741.458754] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  741.471096] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011530, 'name': CreateVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  741.620609] env[65478]: DEBUG oslo_vmware.api [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Task: {'id': task-6011527, 'name': CopyVirtualDisk_Task} progress is 77%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  741.632768] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  741.713987] env[65478]: DEBUG nova.compute.utils [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  741.715913] env[65478]: DEBUG nova.compute.manager [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  741.716146] env[65478]: DEBUG nova.network.neutron [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  741.716450] env[65478]: WARNING neutronclient.v2_0.client [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  741.716683] env[65478]: WARNING neutronclient.v2_0.client [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  741.792592] env[65478]: DEBUG oslo_concurrency.lockutils [None req-19b83b4c-5732-43e8-aa9d-afef2591805b tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Lock "98b2d40a-0c59-4540-b60e-17e5206dea42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.216s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  741.982486] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011530, 'name': CreateVM_Task} progress is 99%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  741.992489] env[65478]: DEBUG oslo_vmware.service [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-454ef00a-7d25-4e87-83ea-4edd3037e460 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  742.002301] env[65478]: DEBUG oslo_vmware.service [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1db877f6-338f-428d-8247-af25e98b258c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  742.042789] env[65478]: DEBUG oslo_vmware.service [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c3fba3a5-81a9-4ad3-b421-e8125dcd0a5a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  742.051833] env[65478]: DEBUG oslo_vmware.service [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-66265c49-e15d-493b-b636-a2a1dd80bbd5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  742.066227] env[65478]: DEBUG nova.compute.provider_tree [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  742.123406] env[65478]: DEBUG oslo_vmware.api [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Task: {'id': task-6011527, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.529121} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  742.123990] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Copied Virtual Disk [datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore2] e4810749-aefd-411e-87c1-5b1b1967538f/e4810749-aefd-411e-87c1-5b1b1967538f.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  742.123990] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  742.124132] env[65478]: DEBUG oslo_vmware.service [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-b8c88a38-351c-4bce-ab6d-b9eb2ce72fa8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  742.131818] env[65478]: DEBUG oslo_vmware.api [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Waiting for the task: (returnval){
[  742.131818] env[65478]:    value = "task-6011531"
[  742.131818] env[65478]:    _type = "Task"
[  742.131818] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  742.146090] env[65478]: DEBUG oslo_vmware.api [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Task: {'id': task-6011531, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  742.223853] env[65478]: DEBUG nova.compute.manager [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  742.399843] env[65478]: DEBUG nova.compute.manager [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Received event network-vif-plugged-320b5203-7ff1-4f52-a15b-995d50391e39 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  742.405382] env[65478]: DEBUG oslo_concurrency.lockutils [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] Acquiring lock "98b2d40a-0c59-4540-b60e-17e5206dea42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  742.405572] env[65478]: DEBUG oslo_concurrency.lockutils [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] Lock "98b2d40a-0c59-4540-b60e-17e5206dea42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  742.405703] env[65478]: DEBUG oslo_concurrency.lockutils [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] Lock "98b2d40a-0c59-4540-b60e-17e5206dea42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  742.405835] env[65478]: DEBUG nova.compute.manager [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] No waiting events found dispatching network-vif-plugged-320b5203-7ff1-4f52-a15b-995d50391e39 {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  742.405965] env[65478]: WARNING nova.compute.manager [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Received unexpected event network-vif-plugged-320b5203-7ff1-4f52-a15b-995d50391e39 for instance with vm_state active and task_state None.
[  742.406103] env[65478]: DEBUG nova.compute.manager [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Received event network-changed-320b5203-7ff1-4f52-a15b-995d50391e39 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  742.406212] env[65478]: DEBUG nova.compute.manager [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Refreshing instance network info cache due to event network-changed-320b5203-7ff1-4f52-a15b-995d50391e39. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  742.406344] env[65478]: DEBUG oslo_concurrency.lockutils [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] Acquiring lock "refresh_cache-98b2d40a-0c59-4540-b60e-17e5206dea42" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  742.406489] env[65478]: DEBUG oslo_concurrency.lockutils [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] Acquired lock "refresh_cache-98b2d40a-0c59-4540-b60e-17e5206dea42" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  742.406574] env[65478]: DEBUG nova.network.neutron [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Refreshing network info cache for port 320b5203-7ff1-4f52-a15b-995d50391e39 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  742.471348] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011530, 'name': CreateVM_Task, 'duration_secs': 0.566189} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  742.471505] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  742.478031] env[65478]: WARNING neutronclient.v2_0.client [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  742.478031] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  742.478031] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  742.478031] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Acquired external semaphore "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  742.478271] env[65478]: DEBUG oslo_vmware.service [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-3541d3ba-307d-4db0-a319-3e5fe6c3ac1d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  742.482831] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Waiting for the task: (returnval){
[  742.482831] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]520b4670-9e68-d1fb-7264-62ed2ed729f3"
[  742.482831] env[65478]:    _type = "Task"
[  742.482831] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  742.493197] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]520b4670-9e68-d1fb-7264-62ed2ed729f3, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  742.508629] env[65478]: DEBUG nova.policy [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1dcf390fa3b048ed98b3069887a6b7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70efc035843c47d69ec6a42f446a2b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  742.535378] env[65478]: DEBUG nova.network.neutron [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  742.571085] env[65478]: DEBUG nova.scheduler.client.report [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  742.643069] env[65478]: DEBUG oslo_vmware.api [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Task: {'id': task-6011531, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.069778} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  742.643436] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  742.644303] env[65478]: DEBUG oslo_vmware.service [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-cb8c8f8b-b6aa-4bfe-b3a1-c13a513a4033 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  742.676413] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Reconfiguring VM instance instance-0000000b to attach disk [datastore2] e4810749-aefd-411e-87c1-5b1b1967538f/e4810749-aefd-411e-87c1-5b1b1967538f.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  742.676413] env[65478]: DEBUG oslo_vmware.service [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-1f478bb0-1fbc-4976-89ab-d771b9ae6b46 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  742.697577] env[65478]: DEBUG oslo_vmware.api [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Waiting for the task: (returnval){
[  742.697577] env[65478]:    value = "task-6011532"
[  742.697577] env[65478]:    _type = "Task"
[  742.697577] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  742.707970] env[65478]: DEBUG oslo_vmware.api [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Task: {'id': task-6011532, 'name': ReconfigVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  742.909440] env[65478]: WARNING neutronclient.v2_0.client [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  742.977471] env[65478]: DEBUG nova.network.neutron [-] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  742.997147] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]520b4670-9e68-d1fb-7264-62ed2ed729f3, 'name': SearchDatastore_Task, 'duration_secs': 0.009933} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  742.997482] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  742.997677] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  742.997974] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  742.998135] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  742.998289] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Creating directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  742.998593] env[65478]: DEBUG oslo_vmware.service [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-fe8249f0-4da8-4b62-8e1e-89ad83826eca {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  743.010024] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Created directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  743.010024] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Folder [datastore1] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  743.010024] env[65478]: DEBUG oslo_vmware.service [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-b4808b54-96fa-4437-b646-40a5a34f25ff {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  743.015027] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Waiting for the task: (returnval){
[  743.015027] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]523667a0-acd3-d7ae-b0a4-bfa4b99d0a80"
[  743.015027] env[65478]:    _type = "Task"
[  743.015027] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  743.023756] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]523667a0-acd3-d7ae-b0a4-bfa4b99d0a80, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  743.078946] env[65478]: DEBUG oslo_concurrency.lockutils [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.869s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  743.113289] env[65478]: INFO nova.scheduler.client.report [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Deleted allocations for instance f19f4a44-cae7-4ce1-ae57-a6155c93ed54
[  743.209829] env[65478]: DEBUG oslo_vmware.api [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Task: {'id': task-6011532, 'name': ReconfigVM_Task, 'duration_secs': 0.321153} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  743.211524] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Reconfigured VM instance instance-0000000b to attach disk [datastore2] e4810749-aefd-411e-87c1-5b1b1967538f/e4810749-aefd-411e-87c1-5b1b1967538f.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  743.211524] env[65478]: DEBUG oslo_vmware.service [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-3236cdfb-839a-45fb-9de2-9b53e5a49417 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  743.217046] env[65478]: DEBUG oslo_vmware.api [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Waiting for the task: (returnval){
[  743.217046] env[65478]:    value = "task-6011533"
[  743.217046] env[65478]:    _type = "Task"
[  743.217046] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  743.230020] env[65478]: DEBUG oslo_vmware.api [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Task: {'id': task-6011533, 'name': Rename_Task} progress is 5%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  743.244561] env[65478]: DEBUG nova.compute.manager [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  743.278371] env[65478]: DEBUG nova.virt.hardware [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1066407871',id=21,is_public=True,memory_mb=192,name='tempest-flavor_with_ephemeral_0-1542885089',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  743.278831] env[65478]: DEBUG nova.virt.hardware [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  743.279095] env[65478]: DEBUG nova.virt.hardware [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  743.279363] env[65478]: DEBUG nova.virt.hardware [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  743.279590] env[65478]: DEBUG nova.virt.hardware [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  743.279794] env[65478]: DEBUG nova.virt.hardware [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  743.280094] env[65478]: DEBUG nova.virt.hardware [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  743.280382] env[65478]: DEBUG nova.virt.hardware [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  743.280654] env[65478]: DEBUG nova.virt.hardware [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  743.280888] env[65478]: DEBUG nova.virt.hardware [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  743.281162] env[65478]: DEBUG nova.virt.hardware [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  743.282318] env[65478]: DEBUG oslo_vmware.service [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9f207fb9-5623-436d-accd-7a34aca78e67 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  743.291126] env[65478]: DEBUG oslo_vmware.service [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1a684fee-dc41-4731-afb4-606f91d2cd84 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  743.481437] env[65478]: INFO nova.compute.manager [-] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Took 2.09 seconds to deallocate network for instance.
[  743.535324] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]523667a0-acd3-d7ae-b0a4-bfa4b99d0a80, 'name': SearchDatastore_Task, 'duration_secs': 0.010793} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  743.536544] env[65478]: DEBUG oslo_vmware.service [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-22969505-ccbc-4667-a1b3-73c57f20af45 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  743.542173] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Waiting for the task: (returnval){
[  743.542173] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]525cdab2-7464-2549-7ba8-7203dd57b3ed"
[  743.542173] env[65478]:    _type = "Task"
[  743.542173] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  743.550449] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]525cdab2-7464-2549-7ba8-7203dd57b3ed, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  743.626292] env[65478]: DEBUG oslo_concurrency.lockutils [None req-61dbe954-2cfb-45b9-8085-3687321d0722 tempest-ServerDiagnosticsTest-637004203 tempest-ServerDiagnosticsTest-637004203-project-member] Lock "f19f4a44-cae7-4ce1-ae57-a6155c93ed54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.914s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  743.729927] env[65478]: DEBUG oslo_vmware.api [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Task: {'id': task-6011533, 'name': Rename_Task, 'duration_secs': 0.171135} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  743.730360] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  743.730819] env[65478]: DEBUG oslo_vmware.service [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-dff5f8ff-b18d-4466-9af1-ddae313d07e2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  743.738374] env[65478]: DEBUG oslo_vmware.api [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Waiting for the task: (returnval){
[  743.738374] env[65478]:    value = "task-6011534"
[  743.738374] env[65478]:    _type = "Task"
[  743.738374] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  743.749879] env[65478]: DEBUG oslo_vmware.api [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Task: {'id': task-6011534, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  743.991999] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  743.991999] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  743.991999] env[65478]: DEBUG nova.objects.instance [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Lazy-loading 'resources' on Instance uuid 79200ab1-07f5-48a8-b2f0-b670852df5a0 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  744.060829] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]525cdab2-7464-2549-7ba8-7203dd57b3ed, 'name': SearchDatastore_Task, 'duration_secs': 0.010591} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  744.062669] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  744.062669] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Copying Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 6a23cbd2-7031-484c-809e-436397029c7d/6a23cbd2-7031-484c-809e-436397029c7d.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  744.062669] env[65478]: DEBUG oslo_vmware.service [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-93990bb8-7db3-40f9-98d4-f1628e3febfa {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  744.069047] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Waiting for the task: (returnval){
[  744.069047] env[65478]:    value = "task-6011535"
[  744.069047] env[65478]:    _type = "Task"
[  744.069047] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  744.079249] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Task: {'id': task-6011535, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  744.233539] env[65478]: DEBUG nova.compute.manager [req-7692d2ec-b404-46ec-bc5b-a47d06250cc4 req-9e4ee995-2633-4183-887c-4e6bc5d501e2 service nova] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Received event network-vif-plugged-0d1a1269-dc87-4884-8918-e8ebaaa034f7 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  744.233539] env[65478]: DEBUG oslo_concurrency.lockutils [req-7692d2ec-b404-46ec-bc5b-a47d06250cc4 req-9e4ee995-2633-4183-887c-4e6bc5d501e2 service nova] Acquiring lock "6a23cbd2-7031-484c-809e-436397029c7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  744.233724] env[65478]: DEBUG oslo_concurrency.lockutils [req-7692d2ec-b404-46ec-bc5b-a47d06250cc4 req-9e4ee995-2633-4183-887c-4e6bc5d501e2 service nova] Lock "6a23cbd2-7031-484c-809e-436397029c7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  744.234171] env[65478]: DEBUG oslo_concurrency.lockutils [req-7692d2ec-b404-46ec-bc5b-a47d06250cc4 req-9e4ee995-2633-4183-887c-4e6bc5d501e2 service nova] Lock "6a23cbd2-7031-484c-809e-436397029c7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  744.234479] env[65478]: DEBUG nova.compute.manager [req-7692d2ec-b404-46ec-bc5b-a47d06250cc4 req-9e4ee995-2633-4183-887c-4e6bc5d501e2 service nova] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] No waiting events found dispatching network-vif-plugged-0d1a1269-dc87-4884-8918-e8ebaaa034f7 {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  744.234668] env[65478]: WARNING nova.compute.manager [req-7692d2ec-b404-46ec-bc5b-a47d06250cc4 req-9e4ee995-2633-4183-887c-4e6bc5d501e2 service nova] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Received unexpected event network-vif-plugged-0d1a1269-dc87-4884-8918-e8ebaaa034f7 for instance with vm_state building and task_state spawning.
[  744.234849] env[65478]: DEBUG nova.compute.manager [req-7692d2ec-b404-46ec-bc5b-a47d06250cc4 req-9e4ee995-2633-4183-887c-4e6bc5d501e2 service nova] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Received event network-changed-0d1a1269-dc87-4884-8918-e8ebaaa034f7 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  744.235016] env[65478]: DEBUG nova.compute.manager [req-7692d2ec-b404-46ec-bc5b-a47d06250cc4 req-9e4ee995-2633-4183-887c-4e6bc5d501e2 service nova] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Refreshing instance network info cache due to event network-changed-0d1a1269-dc87-4884-8918-e8ebaaa034f7. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  744.235400] env[65478]: DEBUG oslo_concurrency.lockutils [req-7692d2ec-b404-46ec-bc5b-a47d06250cc4 req-9e4ee995-2633-4183-887c-4e6bc5d501e2 service nova] Acquiring lock "refresh_cache-6a23cbd2-7031-484c-809e-436397029c7d" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  744.235536] env[65478]: DEBUG oslo_concurrency.lockutils [req-7692d2ec-b404-46ec-bc5b-a47d06250cc4 req-9e4ee995-2633-4183-887c-4e6bc5d501e2 service nova] Acquired lock "refresh_cache-6a23cbd2-7031-484c-809e-436397029c7d" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  744.235740] env[65478]: DEBUG nova.network.neutron [req-7692d2ec-b404-46ec-bc5b-a47d06250cc4 req-9e4ee995-2633-4183-887c-4e6bc5d501e2 service nova] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Refreshing network info cache for port 0d1a1269-dc87-4884-8918-e8ebaaa034f7 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  744.253470] env[65478]: DEBUG oslo_vmware.api [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Task: {'id': task-6011534, 'name': PowerOnVM_Task} progress is 66%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  744.585438] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Task: {'id': task-6011535, 'name': CopyVirtualDisk_Task} progress is 25%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  744.751096] env[65478]: WARNING neutronclient.v2_0.client [req-7692d2ec-b404-46ec-bc5b-a47d06250cc4 req-9e4ee995-2633-4183-887c-4e6bc5d501e2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  744.760569] env[65478]: DEBUG oslo_vmware.api [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Task: {'id': task-6011534, 'name': PowerOnVM_Task, 'duration_secs': 0.714114} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  744.761536] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  744.761671] env[65478]: INFO nova.compute.manager [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Took 10.83 seconds to spawn the instance on the hypervisor.
[  744.761856] env[65478]: DEBUG nova.compute.manager [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  744.763980] env[65478]: DEBUG oslo_vmware.service [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4f7aaf13-3329-4f98-8f2e-9bee86a2440b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  744.889747] env[65478]: DEBUG oslo_vmware.service [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-7b273b87-d6ec-40d9-b4b3-ae310974d568 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  744.901898] env[65478]: DEBUG oslo_vmware.service [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-608998ee-b6f5-4ef3-b183-7fe4af55044e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  744.943811] env[65478]: DEBUG oslo_vmware.service [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e9ecda2a-74dc-4355-bfdd-67ab276ceced {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  744.951712] env[65478]: DEBUG oslo_vmware.service [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-5fbe279b-3371-4040-bf6c-bc1b4c5de5c8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  744.970725] env[65478]: DEBUG nova.compute.provider_tree [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  744.981460] env[65478]: DEBUG oslo_concurrency.lockutils [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Acquiring lock "eb466e5e-a499-4856-9c12-c7ca87b53230" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  744.981676] env[65478]: DEBUG oslo_concurrency.lockutils [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Lock "eb466e5e-a499-4856-9c12-c7ca87b53230" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  745.088100] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Task: {'id': task-6011535, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.709938} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  745.088100] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Copied Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 6a23cbd2-7031-484c-809e-436397029c7d/6a23cbd2-7031-484c-809e-436397029c7d.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  745.088100] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  745.088100] env[65478]: DEBUG oslo_vmware.service [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-bfe16410-b844-46d4-9042-710dd05bf18e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  745.094982] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Waiting for the task: (returnval){
[  745.094982] env[65478]:    value = "task-6011536"
[  745.094982] env[65478]:    _type = "Task"
[  745.094982] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  745.105959] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Task: {'id': task-6011536, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  745.249525] env[65478]: DEBUG nova.network.neutron [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Successfully created port: 2fb52993-7218-432a-bea9-5337867a80b6 {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  745.305076] env[65478]: INFO nova.compute.manager [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Took 16.82 seconds to build instance.
[  745.473997] env[65478]: DEBUG nova.scheduler.client.report [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  745.487258] env[65478]: DEBUG nova.compute.manager [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  745.605468] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Task: {'id': task-6011536, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.069112} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  745.607176] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  745.608645] env[65478]: DEBUG oslo_vmware.service [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a66c276b-016e-4e48-b893-8e946f931491 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  745.643341] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Reconfiguring VM instance instance-0000000c to attach disk [datastore1] 6a23cbd2-7031-484c-809e-436397029c7d/6a23cbd2-7031-484c-809e-436397029c7d.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  745.643679] env[65478]: DEBUG oslo_vmware.service [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-34d575c2-f6bd-4dd5-851c-49a536111180 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  745.666397] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Waiting for the task: (returnval){
[  745.666397] env[65478]:    value = "task-6011537"
[  745.666397] env[65478]:    _type = "Task"
[  745.666397] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  745.674762] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Task: {'id': task-6011537, 'name': ReconfigVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  745.807565] env[65478]: DEBUG oslo_concurrency.lockutils [None req-62f88fbb-fa5c-48b8-b2ca-b60c2bb5610b tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Lock "e4810749-aefd-411e-87c1-5b1b1967538f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.341s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  745.919404] env[65478]: WARNING neutronclient.v2_0.client [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  745.980867] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.990s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  746.017709] env[65478]: DEBUG oslo_concurrency.lockutils [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  746.018049] env[65478]: DEBUG oslo_concurrency.lockutils [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  746.020153] env[65478]: INFO nova.compute.claims [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  746.024544] env[65478]: INFO nova.scheduler.client.report [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Deleted allocations for instance 79200ab1-07f5-48a8-b2f0-b670852df5a0
[  746.177928] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Task: {'id': task-6011537, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  746.536866] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7b5ddbe8-4e40-4a2c-81a3-9861e151784f tempest-TenantUsagesTestJSON-704981362 tempest-TenantUsagesTestJSON-704981362-project-member] Lock "79200ab1-07f5-48a8-b2f0-b670852df5a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.776s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  746.679748] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Task: {'id': task-6011537, 'name': ReconfigVM_Task, 'duration_secs': 0.964668} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  746.679963] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Reconfigured VM instance instance-0000000c to attach disk [datastore1] 6a23cbd2-7031-484c-809e-436397029c7d/6a23cbd2-7031-484c-809e-436397029c7d.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  746.681146] env[65478]: DEBUG oslo_vmware.service [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-b0347a35-99e9-4207-915f-6759e3ce3a2f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  746.690893] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Waiting for the task: (returnval){
[  746.690893] env[65478]:    value = "task-6011538"
[  746.690893] env[65478]:    _type = "Task"
[  746.690893] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  746.698791] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Task: {'id': task-6011538, 'name': Rename_Task} progress is 5%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  747.202587] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Task: {'id': task-6011538, 'name': Rename_Task, 'duration_secs': 0.371474} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  747.209283] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  747.209677] env[65478]: DEBUG oslo_vmware.service [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-3bcacee3-5b0b-4c96-9904-74f0854262b3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  747.217437] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Waiting for the task: (returnval){
[  747.217437] env[65478]:    value = "task-6011539"
[  747.217437] env[65478]:    _type = "Task"
[  747.217437] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  747.228046] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Task: {'id': task-6011539, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  747.286643] env[65478]: DEBUG oslo_vmware.service [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8600b799-2018-4958-8db1-604908ce77d0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  747.292716] env[65478]: DEBUG nova.network.neutron [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Updating instance_info_cache with network_info: [{"id": "958d3060-f044-4655-8c5e-bd81773ad096", "address": "fa:16:3e:d1:a0:bc", "network": {"id": "eab0e877-79ef-45b8-a26f-7dd517a13b53", "bridge": "br-int", "label": "tempest-FloatingIPsAssociationTestJSON-364284774-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "7dd8c4cd35c44466b1991950f28d886b", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "054fcd1e-638e-425a-a1de-78cb188ae026", "external-id": "nsx-vlan-transportzone-658", "segmentation_id": 658, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap958d3060-f0", "ovs_interfaceid": "958d3060-f044-4655-8c5e-bd81773ad096", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  747.297788] env[65478]: DEBUG oslo_vmware.service [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f68f957f-f409-4259-adab-f5964a084fa0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  747.339554] env[65478]: DEBUG oslo_vmware.service [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-99b4b8c6-5656-40d8-9223-a4a29089f777 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  747.351703] env[65478]: DEBUG oslo_vmware.service [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0daab65e-2ba0-452e-a334-f3608cb95a73 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  747.370413] env[65478]: DEBUG nova.compute.provider_tree [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  747.403531] env[65478]: DEBUG nova.network.neutron [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Successfully updated port: 2fb52993-7218-432a-bea9-5337867a80b6 {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  747.438165] env[65478]: WARNING neutronclient.v2_0.client [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  747.672645] env[65478]: WARNING neutronclient.v2_0.client [req-7692d2ec-b404-46ec-bc5b-a47d06250cc4 req-9e4ee995-2633-4183-887c-4e6bc5d501e2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  747.729237] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Task: {'id': task-6011539, 'name': PowerOnVM_Task} progress is 1%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  747.730383] env[65478]: DEBUG nova.network.neutron [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Updated VIF entry in instance network info cache for port 320b5203-7ff1-4f52-a15b-995d50391e39. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  747.730754] env[65478]: DEBUG nova.network.neutron [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Updating instance_info_cache with network_info: [{"id": "320b5203-7ff1-4f52-a15b-995d50391e39", "address": "fa:16:3e:c7:10:4c", "network": {"id": "4a1b5d4b-4c82-4116-be7c-20e7f0f647cd", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1744686632-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "183f1111bd4a4c13a354835aa7266cc2", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "c2d3bf80-d60a-4b53-a00a-1381de6d4a12", "external-id": "nsx-vlan-transportzone-982", "segmentation_id": 982, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap320b5203-7f", "ovs_interfaceid": "320b5203-7ff1-4f52-a15b-995d50391e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  747.804608] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Releasing lock "refresh_cache-88cd130c-b811-4789-aea2-964848abdd69" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  747.804608] env[65478]: DEBUG nova.compute.manager [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Instance network_info: |[{"id": "958d3060-f044-4655-8c5e-bd81773ad096", "address": "fa:16:3e:d1:a0:bc", "network": {"id": "eab0e877-79ef-45b8-a26f-7dd517a13b53", "bridge": "br-int", "label": "tempest-FloatingIPsAssociationTestJSON-364284774-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "7dd8c4cd35c44466b1991950f28d886b", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "054fcd1e-638e-425a-a1de-78cb188ae026", "external-id": "nsx-vlan-transportzone-658", "segmentation_id": 658, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap958d3060-f0", "ovs_interfaceid": "958d3060-f044-4655-8c5e-bd81773ad096", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  747.806537] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:d1:a0:bc', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': '054fcd1e-638e-425a-a1de-78cb188ae026', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': '958d3060-f044-4655-8c5e-bd81773ad096', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  747.815479] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  747.815769] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  747.816172] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-1ca440ce-20a3-4b5f-bd75-229a6d49c2be {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  747.838687] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  747.838687] env[65478]:    value = "task-6011540"
[  747.838687] env[65478]:    _type = "Task"
[  747.838687] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  747.848041] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011540, 'name': CreateVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  747.874035] env[65478]: DEBUG nova.scheduler.client.report [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  747.908838] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Acquiring lock "refresh_cache-4f7fb80a-cb05-4bd5-bb10-380d95b2e892" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  747.909078] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Acquired lock "refresh_cache-4f7fb80a-cb05-4bd5-bb10-380d95b2e892" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  747.909298] env[65478]: DEBUG nova.network.neutron [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  747.988350] env[65478]: DEBUG nova.network.neutron [req-7692d2ec-b404-46ec-bc5b-a47d06250cc4 req-9e4ee995-2633-4183-887c-4e6bc5d501e2 service nova] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Updated VIF entry in instance network info cache for port 0d1a1269-dc87-4884-8918-e8ebaaa034f7. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  747.988576] env[65478]: DEBUG nova.network.neutron [req-7692d2ec-b404-46ec-bc5b-a47d06250cc4 req-9e4ee995-2633-4183-887c-4e6bc5d501e2 service nova] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Updating instance_info_cache with network_info: [{"id": "0d1a1269-dc87-4884-8918-e8ebaaa034f7", "address": "fa:16:3e:be:31:73", "network": {"id": "0b606843-0f39-40db-bf5a-f9db85f44b4a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-98949410-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "7482d231bd7d499c9c6ea1c2957612ad", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "37e8d2ee-abfc-42e2-a8fa-ee5447f1f1da", "external-id": "nsx-vlan-transportzone-813", "segmentation_id": 813, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap0d1a1269-dc", "ovs_interfaceid": "0d1a1269-dc87-4884-8918-e8ebaaa034f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  748.237855] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Task: {'id': task-6011539, 'name': PowerOnVM_Task} progress is 82%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  748.242195] env[65478]: DEBUG oslo_concurrency.lockutils [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] Releasing lock "refresh_cache-98b2d40a-0c59-4540-b60e-17e5206dea42" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  748.242452] env[65478]: DEBUG nova.compute.manager [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Received event network-vif-plugged-77d4d422-ea65-4577-ae8a-77615259cfb1 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  748.242660] env[65478]: DEBUG oslo_concurrency.lockutils [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] Acquiring lock "e4810749-aefd-411e-87c1-5b1b1967538f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  748.243407] env[65478]: DEBUG oslo_concurrency.lockutils [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] Lock "e4810749-aefd-411e-87c1-5b1b1967538f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  748.243407] env[65478]: DEBUG oslo_concurrency.lockutils [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] Lock "e4810749-aefd-411e-87c1-5b1b1967538f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  748.243407] env[65478]: DEBUG nova.compute.manager [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] No waiting events found dispatching network-vif-plugged-77d4d422-ea65-4577-ae8a-77615259cfb1 {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  748.244275] env[65478]: WARNING nova.compute.manager [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Received unexpected event network-vif-plugged-77d4d422-ea65-4577-ae8a-77615259cfb1 for instance with vm_state building and task_state spawning.
[  748.244617] env[65478]: DEBUG nova.compute.manager [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Received event network-changed-77d4d422-ea65-4577-ae8a-77615259cfb1 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  748.244617] env[65478]: DEBUG nova.compute.manager [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Refreshing instance network info cache due to event network-changed-77d4d422-ea65-4577-ae8a-77615259cfb1. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  748.244796] env[65478]: DEBUG oslo_concurrency.lockutils [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] Acquiring lock "refresh_cache-e4810749-aefd-411e-87c1-5b1b1967538f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  748.244796] env[65478]: DEBUG oslo_concurrency.lockutils [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] Acquired lock "refresh_cache-e4810749-aefd-411e-87c1-5b1b1967538f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  748.244913] env[65478]: DEBUG nova.network.neutron [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Refreshing network info cache for port 77d4d422-ea65-4577-ae8a-77615259cfb1 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  748.351645] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011540, 'name': CreateVM_Task, 'duration_secs': 0.339839} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  748.351925] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  748.352964] env[65478]: WARNING neutronclient.v2_0.client [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  748.353366] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  748.353513] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  748.353761] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Acquired external semaphore "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  748.354116] env[65478]: DEBUG oslo_vmware.service [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-85a31f4d-739a-4eaa-854d-aa2691a413b1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  748.359883] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for the task: (returnval){
[  748.359883] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52eb1164-a66f-0066-bf5c-456aafc751b1"
[  748.359883] env[65478]:    _type = "Task"
[  748.359883] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  748.374621] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52eb1164-a66f-0066-bf5c-456aafc751b1, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  748.379383] env[65478]: DEBUG oslo_concurrency.lockutils [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.361s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  748.380062] env[65478]: DEBUG nova.compute.manager [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  748.492648] env[65478]: DEBUG oslo_concurrency.lockutils [req-7692d2ec-b404-46ec-bc5b-a47d06250cc4 req-9e4ee995-2633-4183-887c-4e6bc5d501e2 service nova] Releasing lock "refresh_cache-6a23cbd2-7031-484c-809e-436397029c7d" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  748.709617] env[65478]: INFO nova.compute.manager [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Rebuilding instance
[  748.733683] env[65478]: DEBUG oslo_vmware.api [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Task: {'id': task-6011539, 'name': PowerOnVM_Task, 'duration_secs': 1.121583} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  748.738549] env[65478]: DEBUG nova.network.neutron [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  748.743825] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  748.746485] env[65478]: INFO nova.compute.manager [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Took 12.35 seconds to spawn the instance on the hypervisor.
[  748.749703] env[65478]: DEBUG nova.compute.manager [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  748.751197] env[65478]: DEBUG oslo_vmware.service [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-2bf710ab-733c-49dd-9f42-655265e2237d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  748.756385] env[65478]: WARNING neutronclient.v2_0.client [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  748.777180] env[65478]: DEBUG nova.compute.manager [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  748.780115] env[65478]: DEBUG oslo_vmware.service [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-84720a30-bc94-4f05-a914-e85871560454 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  748.872944] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52eb1164-a66f-0066-bf5c-456aafc751b1, 'name': SearchDatastore_Task, 'duration_secs': 0.009728} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  748.872944] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  748.872944] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  748.873165] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  748.874021] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  748.874021] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Creating directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  748.874021] env[65478]: DEBUG oslo_vmware.service [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-19d97e4b-516a-4006-9096-003d9e6a1b0a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  748.885285] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Created directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  748.885285] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Folder [datastore1] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  748.885285] env[65478]: DEBUG oslo_vmware.service [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-ec533305-18c4-4876-96dc-597e058de5ed {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  748.887094] env[65478]: DEBUG nova.compute.utils [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  748.893402] env[65478]: DEBUG nova.compute.manager [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  748.895654] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for the task: (returnval){
[  748.895654] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c4664e-5150-207d-6a14-0b5ea0c94a0b"
[  748.895654] env[65478]:    _type = "Task"
[  748.895654] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  748.901090] env[65478]: DEBUG nova.network.neutron [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  748.904535] env[65478]: WARNING neutronclient.v2_0.client [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  748.907092] env[65478]: WARNING neutronclient.v2_0.client [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  748.913797] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c4664e-5150-207d-6a14-0b5ea0c94a0b, 'name': SearchDatastore_Task, 'duration_secs': 0.009459} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  748.914987] env[65478]: DEBUG oslo_vmware.service [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-a3668246-5ab6-4783-b437-1d03f1ed2d27 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  748.921110] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for the task: (returnval){
[  748.921110] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52d3e986-128d-18b1-225f-af4226aea471"
[  748.921110] env[65478]:    _type = "Task"
[  748.921110] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  748.928952] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52d3e986-128d-18b1-225f-af4226aea471, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  749.035412] env[65478]: DEBUG nova.policy [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7cd1c7abf8384d80aa76de6e558530dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d4c6f3c8d4a40f68deffc1fd31d86ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  749.251108] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Acquiring lock "eb076624-c76c-47da-9320-5fc13a51b365" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  749.251438] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Lock "eb076624-c76c-47da-9320-5fc13a51b365" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  749.274950] env[65478]: INFO nova.compute.manager [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Took 17.91 seconds to build instance.
[  749.407565] env[65478]: DEBUG nova.compute.manager [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  749.430906] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52d3e986-128d-18b1-225f-af4226aea471, 'name': SearchDatastore_Task, 'duration_secs': 0.008945} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  749.431039] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  749.431244] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Copying Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 88cd130c-b811-4789-aea2-964848abdd69/88cd130c-b811-4789-aea2-964848abdd69.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  749.431485] env[65478]: DEBUG oslo_vmware.service [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-36ef2899-8374-431f-bdce-d6fe649cb5fb {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  749.437415] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for the task: (returnval){
[  749.437415] env[65478]:    value = "task-6011541"
[  749.437415] env[65478]:    _type = "Task"
[  749.437415] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  749.445384] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011541, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  749.717612] env[65478]: WARNING neutronclient.v2_0.client [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  749.754593] env[65478]: DEBUG nova.compute.manager [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  749.786150] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c5b5a8f5-593f-4347-ae83-cf9a6752dac3 tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Lock "6a23cbd2-7031-484c-809e-436397029c7d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.434s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  749.801711] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  749.802698] env[65478]: DEBUG oslo_vmware.service [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-121e0796-5ac4-4e42-9fc2-8cd45cc8ffe0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  749.812795] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Waiting for the task: (returnval){
[  749.812795] env[65478]:    value = "task-6011542"
[  749.812795] env[65478]:    _type = "Task"
[  749.812795] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  749.819433] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011542, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  749.948230] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011541, 'name': CopyVirtualDisk_Task} progress is 89%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  750.069732] env[65478]: DEBUG nova.network.neutron [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Successfully created port: fe1047e6-be6d-4718-a53e-e21e2b96dcc9 {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  750.271661] env[65478]: DEBUG nova.network.neutron [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Updating instance_info_cache with network_info: [{"id": "2fb52993-7218-432a-bea9-5337867a80b6", "address": "fa:16:3e:d1:9e:61", "network": {"id": "2ed010d6-4573-4056-a189-22d86fca4369", "bridge": "br-int", "label": "tempest-ServersWithSpecificFlavorTestJSON-2103777099-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "70efc035843c47d69ec6a42f446a2b91", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "b250e561-3be3-4bae-be1a-162251b1ee31", "external-id": "nsx-vlan-transportzone-464", "segmentation_id": 464, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap2fb52993-72", "ovs_interfaceid": "2fb52993-7218-432a-bea9-5337867a80b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  750.294863] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  750.295113] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  750.296744] env[65478]: INFO nova.compute.claims [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  750.326632] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011542, 'name': PowerOffVM_Task, 'duration_secs': 0.160778} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  750.326838] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  750.327289] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  750.328456] env[65478]: DEBUG oslo_vmware.service [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-21a07218-6679-4739-945d-1786df054701 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  750.337390] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  750.337390] env[65478]: DEBUG oslo_vmware.service [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-421f1263-1d32-42d5-b925-52bf5c397805 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  750.369096] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  750.370237] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Deleting contents of the VM from datastore datastore2 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  750.370922] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Deleting the datastore file [datastore2] 95525483-b7db-427e-87b5-3f946972a250 {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  750.371184] env[65478]: DEBUG oslo_vmware.service [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-0954e0a9-d8e6-4b1a-b2f4-508be84b69f2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  750.387857] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Waiting for the task: (returnval){
[  750.387857] env[65478]:    value = "task-6011544"
[  750.387857] env[65478]:    _type = "Task"
[  750.387857] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  750.403696] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011544, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  750.420019] env[65478]: DEBUG nova.compute.manager [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  750.426019] env[65478]: DEBUG nova.compute.manager [None req-efcb96c9-cd50-4096-94c5-c408390f5d11 tempest-ServerDiagnosticsV248Test-358379843 tempest-ServerDiagnosticsV248Test-358379843-project-admin] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  750.426792] env[65478]: DEBUG oslo_vmware.service [None req-efcb96c9-cd50-4096-94c5-c408390f5d11 tempest-ServerDiagnosticsV248Test-358379843 tempest-ServerDiagnosticsV248Test-358379843-project-admin] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9fe7e5cc-fa7e-4cd5-9023-8249d93c32e3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  750.437218] env[65478]: INFO nova.compute.manager [None req-efcb96c9-cd50-4096-94c5-c408390f5d11 tempest-ServerDiagnosticsV248Test-358379843 tempest-ServerDiagnosticsV248Test-358379843-project-admin] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Retrieving diagnostics
[  750.438336] env[65478]: DEBUG oslo_vmware.service [None req-efcb96c9-cd50-4096-94c5-c408390f5d11 tempest-ServerDiagnosticsV248Test-358379843 tempest-ServerDiagnosticsV248Test-358379843-project-admin] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-296c176b-7ece-449e-a390-1082761f59e2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  750.493344] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011541, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.515891} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  750.493597] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Copied Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 88cd130c-b811-4789-aea2-964848abdd69/88cd130c-b811-4789-aea2-964848abdd69.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  750.494552] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  750.495153] env[65478]: DEBUG oslo_vmware.service [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-51efcb54-b186-4d60-a1c7-948b7e490b76 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  750.500341] env[65478]: DEBUG nova.virt.hardware [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  750.502653] env[65478]: DEBUG nova.virt.hardware [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  750.502653] env[65478]: DEBUG nova.virt.hardware [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  750.502653] env[65478]: DEBUG nova.virt.hardware [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  750.502653] env[65478]: DEBUG nova.virt.hardware [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  750.502653] env[65478]: DEBUG nova.virt.hardware [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  750.502989] env[65478]: DEBUG nova.virt.hardware [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  750.502989] env[65478]: DEBUG nova.virt.hardware [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  750.502989] env[65478]: DEBUG nova.virt.hardware [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  750.502989] env[65478]: DEBUG nova.virt.hardware [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  750.502989] env[65478]: DEBUG nova.virt.hardware [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  750.503891] env[65478]: DEBUG oslo_vmware.service [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1edd6821-1ab0-49d3-86a3-215c999f3b8f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  750.513480] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for the task: (returnval){
[  750.513480] env[65478]:    value = "task-6011545"
[  750.513480] env[65478]:    _type = "Task"
[  750.513480] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  750.525429] env[65478]: DEBUG oslo_vmware.service [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-24d856f8-c2fa-46f1-90d2-5e7827f9816e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  750.544446] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011545, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  750.777572] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Releasing lock "refresh_cache-4f7fb80a-cb05-4bd5-bb10-380d95b2e892" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  750.777922] env[65478]: DEBUG nova.compute.manager [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Instance network_info: |[{"id": "2fb52993-7218-432a-bea9-5337867a80b6", "address": "fa:16:3e:d1:9e:61", "network": {"id": "2ed010d6-4573-4056-a189-22d86fca4369", "bridge": "br-int", "label": "tempest-ServersWithSpecificFlavorTestJSON-2103777099-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "70efc035843c47d69ec6a42f446a2b91", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "b250e561-3be3-4bae-be1a-162251b1ee31", "external-id": "nsx-vlan-transportzone-464", "segmentation_id": 464, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap2fb52993-72", "ovs_interfaceid": "2fb52993-7218-432a-bea9-5337867a80b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  750.782122] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:d1:9e:61', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': 'b250e561-3be3-4bae-be1a-162251b1ee31', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': '2fb52993-7218-432a-bea9-5337867a80b6', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  750.791020] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Creating folder: Project (70efc035843c47d69ec6a42f446a2b91). Parent ref: group-v1161186. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  750.792768] env[65478]: DEBUG oslo_vmware.service [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-2d264e8b-b508-49e6-8924-5f6d1489e9fb {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  750.806406] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Created folder: Project (70efc035843c47d69ec6a42f446a2b91) in parent group-v1161186.
[  750.806406] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Creating folder: Instances. Parent ref: group-v1161224. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  750.806406] env[65478]: DEBUG oslo_vmware.service [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-8068f86a-d363-4322-991e-896535b1f6f4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  750.818069] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Created folder: Instances in parent group-v1161224.
[  750.818957] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  750.819215] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  750.819636] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-7321a8c4-aedf-442c-a240-8f36b553fa79 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  750.845042] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  750.845042] env[65478]:    value = "task-6011548"
[  750.845042] env[65478]:    _type = "Task"
[  750.845042] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  750.853293] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011548, 'name': CreateVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  750.898888] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011544, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.091473} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  750.899112] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  750.899272] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Deleted contents of the VM from datastore datastore2 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  750.899444] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  751.030546] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011545, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.101105} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  751.030715] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  751.031630] env[65478]: DEBUG oslo_vmware.service [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4f2f562e-60a0-4b4b-b9bd-77f609da9c18 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  751.040700] env[65478]: DEBUG nova.compute.manager [req-af2c8cfb-dfa7-4e52-8bb9-0c3e8982e3df req-7add9933-f32f-478f-be58-b82e49c6614c service nova] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Received event network-vif-deleted-5850a379-6213-4351-8b9c-5677d834c517 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  751.040700] env[65478]: DEBUG nova.compute.manager [req-af2c8cfb-dfa7-4e52-8bb9-0c3e8982e3df req-7add9933-f32f-478f-be58-b82e49c6614c service nova] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Received event network-vif-plugged-958d3060-f044-4655-8c5e-bd81773ad096 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  751.040700] env[65478]: DEBUG oslo_concurrency.lockutils [req-af2c8cfb-dfa7-4e52-8bb9-0c3e8982e3df req-7add9933-f32f-478f-be58-b82e49c6614c service nova] Acquiring lock "88cd130c-b811-4789-aea2-964848abdd69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  751.040700] env[65478]: DEBUG oslo_concurrency.lockutils [req-af2c8cfb-dfa7-4e52-8bb9-0c3e8982e3df req-7add9933-f32f-478f-be58-b82e49c6614c service nova] Lock "88cd130c-b811-4789-aea2-964848abdd69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  751.042804] env[65478]: DEBUG oslo_concurrency.lockutils [req-af2c8cfb-dfa7-4e52-8bb9-0c3e8982e3df req-7add9933-f32f-478f-be58-b82e49c6614c service nova] Lock "88cd130c-b811-4789-aea2-964848abdd69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  751.045448] env[65478]: DEBUG nova.compute.manager [req-af2c8cfb-dfa7-4e52-8bb9-0c3e8982e3df req-7add9933-f32f-478f-be58-b82e49c6614c service nova] [instance: 88cd130c-b811-4789-aea2-964848abdd69] No waiting events found dispatching network-vif-plugged-958d3060-f044-4655-8c5e-bd81773ad096 {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  751.045594] env[65478]: WARNING nova.compute.manager [req-af2c8cfb-dfa7-4e52-8bb9-0c3e8982e3df req-7add9933-f32f-478f-be58-b82e49c6614c service nova] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Received unexpected event network-vif-plugged-958d3060-f044-4655-8c5e-bd81773ad096 for instance with vm_state building and task_state spawning.
[  751.045791] env[65478]: DEBUG nova.compute.manager [req-af2c8cfb-dfa7-4e52-8bb9-0c3e8982e3df req-7add9933-f32f-478f-be58-b82e49c6614c service nova] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Received event network-changed-958d3060-f044-4655-8c5e-bd81773ad096 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  751.045898] env[65478]: DEBUG nova.compute.manager [req-af2c8cfb-dfa7-4e52-8bb9-0c3e8982e3df req-7add9933-f32f-478f-be58-b82e49c6614c service nova] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Refreshing instance network info cache due to event network-changed-958d3060-f044-4655-8c5e-bd81773ad096. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  751.047644] env[65478]: DEBUG oslo_concurrency.lockutils [req-af2c8cfb-dfa7-4e52-8bb9-0c3e8982e3df req-7add9933-f32f-478f-be58-b82e49c6614c service nova] Acquiring lock "refresh_cache-88cd130c-b811-4789-aea2-964848abdd69" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  751.047915] env[65478]: DEBUG oslo_concurrency.lockutils [req-af2c8cfb-dfa7-4e52-8bb9-0c3e8982e3df req-7add9933-f32f-478f-be58-b82e49c6614c service nova] Acquired lock "refresh_cache-88cd130c-b811-4789-aea2-964848abdd69" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  751.048134] env[65478]: DEBUG nova.network.neutron [req-af2c8cfb-dfa7-4e52-8bb9-0c3e8982e3df req-7add9933-f32f-478f-be58-b82e49c6614c service nova] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Refreshing network info cache for port 958d3060-f044-4655-8c5e-bd81773ad096 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  751.076241] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Reconfiguring VM instance instance-0000000d to attach disk [datastore1] 88cd130c-b811-4789-aea2-964848abdd69/88cd130c-b811-4789-aea2-964848abdd69.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  751.078397] env[65478]: DEBUG oslo_vmware.service [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-3fe4916c-c6e3-447c-a932-fedd50c10cbe {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  751.104539] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Acquiring lock "788343e6-5c24-4e9b-9c74-e14f3b179cdb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  751.104828] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Lock "788343e6-5c24-4e9b-9c74-e14f3b179cdb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  751.107382] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for the task: (returnval){
[  751.107382] env[65478]:    value = "task-6011549"
[  751.107382] env[65478]:    _type = "Task"
[  751.107382] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  751.120295] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011549, 'name': ReconfigVM_Task} progress is 10%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  751.288010] env[65478]: WARNING neutronclient.v2_0.client [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  751.358565] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011548, 'name': CreateVM_Task} progress is 99%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  751.554186] env[65478]: DEBUG oslo_vmware.service [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-66373231-0e26-4f08-839d-3dc0337d0c25 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  751.562869] env[65478]: DEBUG oslo_vmware.service [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6e0ae7d8-8cfe-4b4f-bf4e-5a3936fac43f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  751.579752] env[65478]: WARNING neutronclient.v2_0.client [req-af2c8cfb-dfa7-4e52-8bb9-0c3e8982e3df req-7add9933-f32f-478f-be58-b82e49c6614c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  751.600658] env[65478]: DEBUG oslo_vmware.service [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-24dd274b-7ffa-452b-b25f-15530c4c5919 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  751.609194] env[65478]: DEBUG oslo_vmware.service [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4877a3f7-7aaf-4f48-8a04-f3c28ce2375f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  751.621194] env[65478]: DEBUG nova.compute.manager [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  751.634936] env[65478]: DEBUG nova.compute.provider_tree [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  751.640345] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011549, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  751.840279] env[65478]: DEBUG nova.network.neutron [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Updated VIF entry in instance network info cache for port 77d4d422-ea65-4577-ae8a-77615259cfb1. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  751.840376] env[65478]: DEBUG nova.network.neutron [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Updating instance_info_cache with network_info: [{"id": "77d4d422-ea65-4577-ae8a-77615259cfb1", "address": "fa:16:3e:52:95:56", "network": {"id": "684d3d46-b7f8-44e4-b8ff-51b0a8c27a1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-600899984-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "88b6f91cedac41a6aeb3e367dace092b", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "5ba07329-1d3e-4ba8-8774-d029262318c4", "external-id": "nsx-vlan-transportzone-534", "segmentation_id": 534, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap77d4d422-ea", "ovs_interfaceid": "77d4d422-ea65-4577-ae8a-77615259cfb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  751.858482] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011548, 'name': CreateVM_Task, 'duration_secs': 0.537786} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  751.858656] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  751.860079] env[65478]: WARNING neutronclient.v2_0.client [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  751.860456] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  751.860570] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  751.861161] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Acquired external semaphore "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  751.861242] env[65478]: DEBUG oslo_vmware.service [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-816f9412-8085-4a5f-b911-6614abd5ec17 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  751.866824] env[65478]: DEBUG oslo_vmware.api [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Waiting for the task: (returnval){
[  751.866824] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52d87cc8-4695-1cfe-c8b9-c6fe632f08df"
[  751.866824] env[65478]:    _type = "Task"
[  751.866824] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  751.876402] env[65478]: DEBUG oslo_vmware.api [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52d87cc8-4695-1cfe-c8b9-c6fe632f08df, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  751.949640] env[65478]: DEBUG nova.virt.hardware [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  751.949836] env[65478]: DEBUG nova.virt.hardware [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  751.949952] env[65478]: DEBUG nova.virt.hardware [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  751.950114] env[65478]: DEBUG nova.virt.hardware [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  751.950219] env[65478]: DEBUG nova.virt.hardware [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  751.950322] env[65478]: DEBUG nova.virt.hardware [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  751.950489] env[65478]: DEBUG nova.virt.hardware [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  751.950602] env[65478]: DEBUG nova.virt.hardware [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  751.950723] env[65478]: DEBUG nova.virt.hardware [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  751.950838] env[65478]: DEBUG nova.virt.hardware [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  751.951137] env[65478]: DEBUG nova.virt.hardware [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  751.952080] env[65478]: DEBUG oslo_vmware.service [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-7204501f-5e08-455e-b3e1-dab1315282e1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  751.960968] env[65478]: DEBUG oslo_vmware.service [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-460fa1c5-c88e-437f-8e0e-3def8eb04878 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  751.980752] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Instance VIF info [] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  751.986950] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  751.987549] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 95525483-b7db-427e-87b5-3f946972a250] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  751.987851] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-e63af93c-e72b-494b-a4d7-7629ae9f46bc {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  752.008249] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  752.008249] env[65478]:    value = "task-6011550"
[  752.008249] env[65478]:    _type = "Task"
[  752.008249] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  752.017137] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011550, 'name': CreateVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  752.123537] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011549, 'name': ReconfigVM_Task, 'duration_secs': 0.805685} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  752.124426] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Reconfigured VM instance instance-0000000d to attach disk [datastore1] 88cd130c-b811-4789-aea2-964848abdd69/88cd130c-b811-4789-aea2-964848abdd69.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  752.125253] env[65478]: DEBUG oslo_vmware.service [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-995c8c38-c6ac-45fe-bae7-530d9e0bc7f0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  752.136045] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for the task: (returnval){
[  752.136045] env[65478]:    value = "task-6011551"
[  752.136045] env[65478]:    _type = "Task"
[  752.136045] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  752.144811] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011551, 'name': Rename_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  752.148058] env[65478]: DEBUG nova.scheduler.client.report [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  752.177171] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  752.275331] env[65478]: DEBUG nova.network.neutron [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Successfully updated port: fe1047e6-be6d-4718-a53e-e21e2b96dcc9 {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  752.344562] env[65478]: DEBUG oslo_concurrency.lockutils [req-3fadee32-8db4-4f15-91d2-777e4d65e661 req-620464f7-96b2-41ef-92ad-87314b897e00 service nova] Releasing lock "refresh_cache-e4810749-aefd-411e-87c1-5b1b1967538f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  752.384017] env[65478]: DEBUG oslo_vmware.api [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52d87cc8-4695-1cfe-c8b9-c6fe632f08df, 'name': SearchDatastore_Task, 'duration_secs': 0.009726} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  752.384959] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  752.384959] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  752.385155] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  752.385613] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  752.386277] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Creating directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  752.386417] env[65478]: DEBUG oslo_vmware.service [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-98677d5c-3c16-41db-8f79-6498092f47f4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  752.395491] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Created directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  752.395491] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Folder [datastore1] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  752.397056] env[65478]: DEBUG oslo_vmware.service [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-808abe7d-9141-4aea-bde2-e4c34b50f8dd {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  752.402663] env[65478]: DEBUG oslo_vmware.api [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Waiting for the task: (returnval){
[  752.402663] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52f14b7b-7174-94ff-d081-c09bc23630d1"
[  752.402663] env[65478]:    _type = "Task"
[  752.402663] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  752.414959] env[65478]: DEBUG oslo_vmware.api [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52f14b7b-7174-94ff-d081-c09bc23630d1, 'name': SearchDatastore_Task, 'duration_secs': 0.00892} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  752.415765] env[65478]: DEBUG oslo_vmware.service [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-d2f71bba-9366-4c1e-9d2f-6445cf6b8a3f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  752.421275] env[65478]: DEBUG oslo_vmware.api [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Waiting for the task: (returnval){
[  752.421275] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]524dbcd4-d646-6d15-4d5a-08ddc464dc1c"
[  752.421275] env[65478]:    _type = "Task"
[  752.421275] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  752.429251] env[65478]: DEBUG oslo_vmware.api [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]524dbcd4-d646-6d15-4d5a-08ddc464dc1c, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  752.517415] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011550, 'name': CreateVM_Task, 'duration_secs': 0.284725} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  752.517778] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 95525483-b7db-427e-87b5-3f946972a250] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  752.518224] env[65478]: DEBUG oslo_concurrency.lockutils [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  752.518346] env[65478]: DEBUG oslo_concurrency.lockutils [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  752.518637] env[65478]: DEBUG oslo_concurrency.lockutils [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Acquired external semaphore "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  752.518992] env[65478]: DEBUG oslo_vmware.service [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-96017d9c-15f4-4eb2-99ff-80a52988fe8e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  752.524178] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Waiting for the task: (returnval){
[  752.524178] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]5286b115-f739-a994-26e6-478ee0a5bc5f"
[  752.524178] env[65478]:    _type = "Task"
[  752.524178] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  752.535084] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5286b115-f739-a994-26e6-478ee0a5bc5f, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  752.660847] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011551, 'name': Rename_Task, 'duration_secs': 0.178903} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  752.662484] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.366s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  752.663473] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.484s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  752.665283] env[65478]: INFO nova.compute.claims [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  752.668128] env[65478]: DEBUG nova.compute.manager [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  752.674185] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  752.674185] env[65478]: DEBUG oslo_vmware.service [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-6ed4f5ea-9f47-4eeb-ac64-9bde2b271794 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  752.683995] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for the task: (returnval){
[  752.683995] env[65478]:    value = "task-6011552"
[  752.683995] env[65478]:    _type = "Task"
[  752.683995] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  752.691449] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011552, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  752.784165] env[65478]: DEBUG oslo_concurrency.lockutils [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Acquiring lock "refresh_cache-eb466e5e-a499-4856-9c12-c7ca87b53230" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  752.784165] env[65478]: DEBUG oslo_concurrency.lockutils [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Acquired lock "refresh_cache-eb466e5e-a499-4856-9c12-c7ca87b53230" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  752.784165] env[65478]: DEBUG nova.network.neutron [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  752.932162] env[65478]: DEBUG oslo_vmware.api [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]524dbcd4-d646-6d15-4d5a-08ddc464dc1c, 'name': SearchDatastore_Task, 'duration_secs': 0.009316} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  752.932532] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  752.932948] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Copying Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 4f7fb80a-cb05-4bd5-bb10-380d95b2e892/4f7fb80a-cb05-4bd5-bb10-380d95b2e892.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  752.933152] env[65478]: DEBUG oslo_vmware.service [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-99428a6c-541d-403f-8be4-55575a0ff0d5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  752.939475] env[65478]: DEBUG oslo_vmware.api [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Waiting for the task: (returnval){
[  752.939475] env[65478]:    value = "task-6011553"
[  752.939475] env[65478]:    _type = "Task"
[  752.939475] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  752.947444] env[65478]: DEBUG oslo_vmware.api [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011553, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  753.037207] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5286b115-f739-a994-26e6-478ee0a5bc5f, 'name': SearchDatastore_Task, 'duration_secs': 0.008213} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  753.038227] env[65478]: DEBUG oslo_concurrency.lockutils [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  753.038487] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  753.038704] env[65478]: DEBUG oslo_concurrency.lockutils [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  753.038815] env[65478]: DEBUG oslo_concurrency.lockutils [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  753.039478] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Creating directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  753.039903] env[65478]: DEBUG oslo_vmware.service [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-adaaf371-ffd1-4dd9-bab3-fb68f44b83b9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  753.048627] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Created directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  753.048627] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Folder [datastore1] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  753.048884] env[65478]: DEBUG oslo_vmware.service [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-43b8b5ef-4490-4244-bee0-973f88d35c37 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  753.057256] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Waiting for the task: (returnval){
[  753.057256] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]5262d827-a2ce-83db-22d3-5bd2f2fa44b0"
[  753.057256] env[65478]:    _type = "Task"
[  753.057256] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  753.065192] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5262d827-a2ce-83db-22d3-5bd2f2fa44b0, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  753.179360] env[65478]: DEBUG nova.compute.utils [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  753.180648] env[65478]: DEBUG nova.compute.manager [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  753.181314] env[65478]: DEBUG nova.network.neutron [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  753.184373] env[65478]: WARNING neutronclient.v2_0.client [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  753.184373] env[65478]: WARNING neutronclient.v2_0.client [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  753.205454] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011552, 'name': PowerOnVM_Task} progress is 1%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  753.451288] env[65478]: DEBUG oslo_vmware.api [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011553, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.509762} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  753.451647] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Copied Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 4f7fb80a-cb05-4bd5-bb10-380d95b2e892/4f7fb80a-cb05-4bd5-bb10-380d95b2e892.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  753.451647] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  753.451772] env[65478]: DEBUG oslo_vmware.service [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-2b0336a6-9226-483e-9836-aa9bc1e5a2aa {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  753.458532] env[65478]: DEBUG oslo_vmware.api [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Waiting for the task: (returnval){
[  753.458532] env[65478]:    value = "task-6011554"
[  753.458532] env[65478]:    _type = "Task"
[  753.458532] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  753.469402] env[65478]: DEBUG oslo_vmware.api [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011554, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  753.550195] env[65478]: WARNING neutronclient.v2_0.client [req-af2c8cfb-dfa7-4e52-8bb9-0c3e8982e3df req-7add9933-f32f-478f-be58-b82e49c6614c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  753.565448] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5262d827-a2ce-83db-22d3-5bd2f2fa44b0, 'name': SearchDatastore_Task, 'duration_secs': 0.00888} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  753.566269] env[65478]: DEBUG oslo_vmware.service [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-1f71028a-88c8-464b-95ae-6e00dab21bcc {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  753.571505] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Waiting for the task: (returnval){
[  753.571505] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]525e336b-8d91-e13e-16cd-85142f580967"
[  753.571505] env[65478]:    _type = "Task"
[  753.571505] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  753.585678] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]525e336b-8d91-e13e-16cd-85142f580967, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  753.594405] env[65478]: DEBUG nova.policy [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '020e74139da84cc69833b9b6d04c8319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc07d4a2be4da3b5bb4900ea76450b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  753.638328] env[65478]: DEBUG nova.network.neutron [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  753.685969] env[65478]: DEBUG nova.compute.manager [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  753.705156] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011552, 'name': PowerOnVM_Task} progress is 1%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  753.970963] env[65478]: DEBUG oslo_vmware.api [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011554, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.066784} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  753.971184] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  753.971977] env[65478]: DEBUG oslo_vmware.service [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e929b13c-26a8-44cd-a952-2982915a90d4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  753.999999] env[65478]: DEBUG oslo_vmware.service [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-46ddc0b4-68d1-4290-80d0-61f97678d55b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  754.012325] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Reconfiguring VM instance instance-0000000e to attach disk [datastore1] 4f7fb80a-cb05-4bd5-bb10-380d95b2e892/4f7fb80a-cb05-4bd5-bb10-380d95b2e892.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  754.014113] env[65478]: DEBUG oslo_vmware.service [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-8ae515f4-306e-49df-8916-db992adb2be0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  754.030614] env[65478]: DEBUG oslo_vmware.service [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-13d33517-8856-407c-b037-a66cc784471d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  754.043143] env[65478]: DEBUG oslo_vmware.api [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Waiting for the task: (returnval){
[  754.043143] env[65478]:    value = "task-6011555"
[  754.043143] env[65478]:    _type = "Task"
[  754.043143] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  754.060867] env[65478]: DEBUG oslo_vmware.api [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011555, 'name': ReconfigVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  754.084166] env[65478]: DEBUG oslo_vmware.service [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0f436b2d-5d1d-4f4f-8086-cb41e54aa13e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  754.094639] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]525e336b-8d91-e13e-16cd-85142f580967, 'name': SearchDatastore_Task, 'duration_secs': 0.016316} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  754.095580] env[65478]: DEBUG oslo_concurrency.lockutils [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  754.098947] env[65478]: DEBUG oslo_vmware.service [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-2b86e75e-f31e-4ab7-8a86-4e03294e6b2f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  754.103806] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Copying Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 95525483-b7db-427e-87b5-3f946972a250/95525483-b7db-427e-87b5-3f946972a250.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  754.104272] env[65478]: DEBUG oslo_vmware.service [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-e52e4faa-5c07-4a6a-bc8c-ee6a18293ca1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  754.115804] env[65478]: DEBUG nova.compute.provider_tree [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  754.119414] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Waiting for the task: (returnval){
[  754.119414] env[65478]:    value = "task-6011556"
[  754.119414] env[65478]:    _type = "Task"
[  754.119414] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  754.132915] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011556, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  754.188932] env[65478]: DEBUG nova.network.neutron [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Successfully created port: 5c9a8578-bb94-4d72-acef-25b60278df21 {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  754.209499] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011552, 'name': PowerOnVM_Task} progress is 64%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  754.283801] env[65478]: DEBUG nova.network.neutron [req-af2c8cfb-dfa7-4e52-8bb9-0c3e8982e3df req-7add9933-f32f-478f-be58-b82e49c6614c service nova] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Updated VIF entry in instance network info cache for port 958d3060-f044-4655-8c5e-bd81773ad096. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  754.284142] env[65478]: DEBUG nova.network.neutron [req-af2c8cfb-dfa7-4e52-8bb9-0c3e8982e3df req-7add9933-f32f-478f-be58-b82e49c6614c service nova] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Updating instance_info_cache with network_info: [{"id": "958d3060-f044-4655-8c5e-bd81773ad096", "address": "fa:16:3e:d1:a0:bc", "network": {"id": "eab0e877-79ef-45b8-a26f-7dd517a13b53", "bridge": "br-int", "label": "tempest-FloatingIPsAssociationTestJSON-364284774-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "7dd8c4cd35c44466b1991950f28d886b", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "054fcd1e-638e-425a-a1de-78cb188ae026", "external-id": "nsx-vlan-transportzone-658", "segmentation_id": 658, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap958d3060-f0", "ovs_interfaceid": "958d3060-f044-4655-8c5e-bd81773ad096", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  754.558559] env[65478]: DEBUG oslo_vmware.api [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011555, 'name': ReconfigVM_Task} progress is 99%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  754.633658] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011556, 'name': CopyVirtualDisk_Task} progress is 77%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  754.634807] env[65478]: DEBUG nova.scheduler.client.report [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  754.706485] env[65478]: DEBUG oslo_vmware.api [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011552, 'name': PowerOnVM_Task, 'duration_secs': 1.853526} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  754.706579] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  754.706842] env[65478]: INFO nova.compute.manager [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Took 15.67 seconds to spawn the instance on the hypervisor.
[  754.706842] env[65478]: DEBUG nova.compute.manager [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  754.707656] env[65478]: DEBUG oslo_vmware.service [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-68a2ee3a-1b67-45eb-9bba-f836bb4c8320 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  754.716156] env[65478]: DEBUG nova.compute.manager [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  754.761645] env[65478]: DEBUG nova.virt.hardware [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  754.762960] env[65478]: DEBUG nova.virt.hardware [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  754.763185] env[65478]: DEBUG nova.virt.hardware [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  754.763588] env[65478]: DEBUG nova.virt.hardware [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  754.763698] env[65478]: DEBUG nova.virt.hardware [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  754.763803] env[65478]: DEBUG nova.virt.hardware [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  754.763968] env[65478]: DEBUG nova.virt.hardware [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  754.764101] env[65478]: DEBUG nova.virt.hardware [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  754.764223] env[65478]: DEBUG nova.virt.hardware [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  754.764348] env[65478]: DEBUG nova.virt.hardware [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  754.764480] env[65478]: DEBUG nova.virt.hardware [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  754.766142] env[65478]: DEBUG oslo_vmware.service [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0085e966-438a-4f2d-9837-3f98e42419d6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  754.777558] env[65478]: DEBUG oslo_vmware.service [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-36001e78-155f-4122-9c97-2708c1f82c34 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  754.787876] env[65478]: DEBUG oslo_concurrency.lockutils [req-af2c8cfb-dfa7-4e52-8bb9-0c3e8982e3df req-7add9933-f32f-478f-be58-b82e49c6614c service nova] Releasing lock "refresh_cache-88cd130c-b811-4789-aea2-964848abdd69" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  754.793524] env[65478]: DEBUG nova.compute.manager [req-af2c8cfb-dfa7-4e52-8bb9-0c3e8982e3df req-7add9933-f32f-478f-be58-b82e49c6614c service nova] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Received event network-vif-deleted-c7a2377a-6ee6-4723-9536-d02ae3418549 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  755.059225] env[65478]: DEBUG oslo_vmware.api [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011555, 'name': ReconfigVM_Task, 'duration_secs': 0.521195} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  755.059225] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Reconfigured VM instance instance-0000000e to attach disk [datastore1] 4f7fb80a-cb05-4bd5-bb10-380d95b2e892/4f7fb80a-cb05-4bd5-bb10-380d95b2e892.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  755.060056] env[65478]: DEBUG oslo_vmware.service [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-efa8719b-de58-414f-81a3-387e4c3b23ca {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  755.071193] env[65478]: DEBUG oslo_vmware.api [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Waiting for the task: (returnval){
[  755.071193] env[65478]:    value = "task-6011557"
[  755.071193] env[65478]:    _type = "Task"
[  755.071193] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  755.084090] env[65478]: DEBUG oslo_vmware.api [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011557, 'name': Rename_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  755.132582] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011556, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.558835} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  755.132582] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Copied Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 95525483-b7db-427e-87b5-3f946972a250/95525483-b7db-427e-87b5-3f946972a250.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  755.132582] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  755.133192] env[65478]: DEBUG oslo_vmware.service [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-c85bae37-2df7-44f2-a5d6-ad6cba43c147 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  755.139077] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Waiting for the task: (returnval){
[  755.139077] env[65478]:    value = "task-6011558"
[  755.139077] env[65478]:    _type = "Task"
[  755.139077] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  755.147672] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.487s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  755.150444] env[65478]: DEBUG nova.compute.manager [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  755.160620] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011558, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  755.233906] env[65478]: INFO nova.compute.manager [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Took 20.70 seconds to build instance.
[  755.406081] env[65478]: WARNING neutronclient.v2_0.client [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  755.548117] env[65478]: DEBUG oslo_concurrency.lockutils [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Acquiring lock "f01c577a-3995-465a-98ae-21880df54cc0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  755.548999] env[65478]: DEBUG oslo_concurrency.lockutils [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Lock "f01c577a-3995-465a-98ae-21880df54cc0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  755.582451] env[65478]: DEBUG oslo_vmware.api [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011557, 'name': Rename_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  755.649072] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011558, 'name': ExtendVirtualDisk_Task} progress is 50%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  755.659814] env[65478]: DEBUG nova.compute.utils [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  755.662676] env[65478]: DEBUG nova.compute.manager [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  755.664429] env[65478]: DEBUG nova.network.neutron [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  755.664544] env[65478]: WARNING neutronclient.v2_0.client [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  755.664789] env[65478]: WARNING neutronclient.v2_0.client [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  755.688935] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Acquiring lock "c444ace8-9651-4df8-8604-982300643449" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  755.689206] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Lock "c444ace8-9651-4df8-8604-982300643449" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  755.689690] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Acquiring lock "c444ace8-9651-4df8-8604-982300643449-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  755.690785] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Lock "c444ace8-9651-4df8-8604-982300643449-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  755.691342] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Lock "c444ace8-9651-4df8-8604-982300643449-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  755.694300] env[65478]: INFO nova.compute.manager [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Terminating instance
[  755.739197] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0aabc427-4261-4ac6-a6b9-235cafe60c04 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Lock "88cd130c-b811-4789-aea2-964848abdd69" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.219s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  756.031451] env[65478]: DEBUG nova.network.neutron [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Successfully updated port: 5c9a8578-bb94-4d72-acef-25b60278df21 {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  756.054560] env[65478]: DEBUG nova.compute.manager [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  756.089623] env[65478]: DEBUG oslo_vmware.api [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011557, 'name': Rename_Task, 'duration_secs': 0.725269} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  756.089781] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  756.090229] env[65478]: DEBUG oslo_vmware.service [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-51f242fd-e812-4a62-806c-38b4350b4331 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  756.094038] env[65478]: DEBUG nova.network.neutron [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Updating instance_info_cache with network_info: [{"id": "fe1047e6-be6d-4718-a53e-e21e2b96dcc9", "address": "fa:16:3e:d1:4a:a6", "network": {"id": "7f931794-a55e-4262-acec-b60daf9cf019", "bridge": "br-int", "label": "tempest-ServersTestManualDisk-1906004701-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d4c6f3c8d4a40f68deffc1fd31d86ba", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "6b151a0c-aa46-4d21-9ef5-c09cf350b19c", "external-id": "nsx-vlan-transportzone-343", "segmentation_id": 343, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapfe1047e6-be", "ovs_interfaceid": "fe1047e6-be6d-4718-a53e-e21e2b96dcc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  756.099472] env[65478]: DEBUG oslo_vmware.api [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Waiting for the task: (returnval){
[  756.099472] env[65478]:    value = "task-6011559"
[  756.099472] env[65478]:    _type = "Task"
[  756.099472] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  756.112574] env[65478]: DEBUG oslo_vmware.api [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011559, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  756.163727] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011558, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.551837} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  756.164524] env[65478]: DEBUG nova.compute.manager [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  756.166864] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  756.171786] env[65478]: DEBUG oslo_vmware.service [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e0227c9d-04d0-4bf4-ad40-e91efd1d50d1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  756.200455] env[65478]: DEBUG nova.compute.manager [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[  756.203849] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  756.204123] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Reconfiguring VM instance instance-00000008 to attach disk [datastore1] 95525483-b7db-427e-87b5-3f946972a250/95525483-b7db-427e-87b5-3f946972a250.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  756.205077] env[65478]: DEBUG oslo_vmware.service [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0d047d77-f0c3-4e4f-a95b-bc5d3b2e8cbf {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  756.211837] env[65478]: DEBUG oslo_vmware.service [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-1d64b560-c866-40d7-9048-584388c17272 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  756.220626] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  756.226217] env[65478]: DEBUG oslo_vmware.service [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-16cdc1c8-790c-4b92-b7ff-2d84131de2af {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  756.240836] env[65478]: DEBUG oslo_vmware.api [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Waiting for the task: (returnval){
[  756.240836] env[65478]:    value = "task-6011560"
[  756.240836] env[65478]:    _type = "Task"
[  756.240836] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  756.245738] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Waiting for the task: (returnval){
[  756.245738] env[65478]:    value = "task-6011561"
[  756.245738] env[65478]:    _type = "Task"
[  756.245738] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  756.254830] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011561, 'name': ReconfigVM_Task} progress is 10%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  756.259196] env[65478]: DEBUG oslo_vmware.api [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Task: {'id': task-6011560, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  756.537024] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Acquiring lock "refresh_cache-eb076624-c76c-47da-9320-5fc13a51b365" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  756.537159] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Acquired lock "refresh_cache-eb076624-c76c-47da-9320-5fc13a51b365" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  756.537308] env[65478]: DEBUG nova.network.neutron [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  756.587462] env[65478]: DEBUG oslo_concurrency.lockutils [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  756.587813] env[65478]: DEBUG oslo_concurrency.lockutils [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  756.590315] env[65478]: INFO nova.compute.claims [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  756.595674] env[65478]: DEBUG nova.policy [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6679585815554a6fae59bef8a3719435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37881a9fe4b44e59ade851fbf1800f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  756.598415] env[65478]: DEBUG oslo_concurrency.lockutils [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Releasing lock "refresh_cache-eb466e5e-a499-4856-9c12-c7ca87b53230" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  756.598694] env[65478]: DEBUG nova.compute.manager [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Instance network_info: |[{"id": "fe1047e6-be6d-4718-a53e-e21e2b96dcc9", "address": "fa:16:3e:d1:4a:a6", "network": {"id": "7f931794-a55e-4262-acec-b60daf9cf019", "bridge": "br-int", "label": "tempest-ServersTestManualDisk-1906004701-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d4c6f3c8d4a40f68deffc1fd31d86ba", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "6b151a0c-aa46-4d21-9ef5-c09cf350b19c", "external-id": "nsx-vlan-transportzone-343", "segmentation_id": 343, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapfe1047e6-be", "ovs_interfaceid": "fe1047e6-be6d-4718-a53e-e21e2b96dcc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  756.599154] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:d1:4a:a6', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': '6b151a0c-aa46-4d21-9ef5-c09cf350b19c', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': 'fe1047e6-be6d-4718-a53e-e21e2b96dcc9', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  756.617942] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Creating folder: Project (4d4c6f3c8d4a40f68deffc1fd31d86ba). Parent ref: group-v1161186. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  756.618652] env[65478]: DEBUG oslo_vmware.service [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-a853bab5-37c2-4a96-b337-023e55a7b027 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  756.622869] env[65478]: DEBUG oslo_vmware.api [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011559, 'name': PowerOnVM_Task} progress is 88%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  756.630255] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Created folder: Project (4d4c6f3c8d4a40f68deffc1fd31d86ba) in parent group-v1161186.
[  756.630454] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Creating folder: Instances. Parent ref: group-v1161228. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  756.631120] env[65478]: DEBUG oslo_vmware.service [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-4346e204-c1b9-46e3-942f-b9932003db5f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  756.642171] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Created folder: Instances in parent group-v1161228.
[  756.644468] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  756.644726] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  756.645088] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-2c1dc01a-c909-4b5d-808e-20a907f19c2e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  756.665754] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  756.665754] env[65478]:    value = "task-6011564"
[  756.665754] env[65478]:    _type = "Task"
[  756.665754] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  756.674583] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011564, 'name': CreateVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  756.758483] env[65478]: DEBUG oslo_vmware.api [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Task: {'id': task-6011560, 'name': PowerOffVM_Task, 'duration_secs': 0.215959} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  756.758714] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  756.759217] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  756.759217] env[65478]: DEBUG oslo_vmware.service [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-d0c0436a-8eff-4692-9680-65a40f0c60e5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  756.766786] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011561, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  756.833531] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Acquiring lock "06b7de0a-c338-44b8-97e7-c80281067528" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  756.833754] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Lock "06b7de0a-c338-44b8-97e7-c80281067528" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  756.833967] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Acquiring lock "06b7de0a-c338-44b8-97e7-c80281067528-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  756.834102] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Lock "06b7de0a-c338-44b8-97e7-c80281067528-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  756.834227] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Lock "06b7de0a-c338-44b8-97e7-c80281067528-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  756.837479] env[65478]: INFO nova.compute.manager [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Terminating instance
[  757.017406] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  757.017406] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Deleting contents of the VM from datastore datastore2 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  757.017573] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Deleting the datastore file [datastore2] c444ace8-9651-4df8-8604-982300643449 {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  757.019733] env[65478]: DEBUG oslo_vmware.service [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-e07a95c3-2d01-4918-8efc-98d9d1a9daab {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  757.026380] env[65478]: DEBUG oslo_vmware.api [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Waiting for the task: (returnval){
[  757.026380] env[65478]:    value = "task-6011566"
[  757.026380] env[65478]:    _type = "Task"
[  757.026380] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  757.047841] env[65478]: DEBUG oslo_vmware.api [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Task: {'id': task-6011566, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  757.125467] env[65478]: DEBUG oslo_vmware.api [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011559, 'name': PowerOnVM_Task, 'duration_secs': 0.645853} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  757.125467] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  757.125865] env[65478]: INFO nova.compute.manager [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Took 13.88 seconds to spawn the instance on the hypervisor.
[  757.125865] env[65478]: DEBUG nova.compute.manager [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  757.127101] env[65478]: DEBUG oslo_vmware.service [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f65d4254-95e4-4ed0-87f5-f1e42610acdd {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  757.177297] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011564, 'name': CreateVM_Task} progress is 25%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  757.184133] env[65478]: DEBUG nova.compute.manager [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  757.210676] env[65478]: DEBUG nova.network.neutron [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Successfully created port: c753d998-c733-4ef7-b4fc-008c7024f5ef {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  757.216399] env[65478]: DEBUG nova.virt.hardware [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  757.216773] env[65478]: DEBUG nova.virt.hardware [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  757.216921] env[65478]: DEBUG nova.virt.hardware [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  757.218444] env[65478]: DEBUG nova.virt.hardware [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  757.218444] env[65478]: DEBUG nova.virt.hardware [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  757.218444] env[65478]: DEBUG nova.virt.hardware [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  757.218444] env[65478]: DEBUG nova.virt.hardware [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  757.218444] env[65478]: DEBUG nova.virt.hardware [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  757.218887] env[65478]: DEBUG nova.virt.hardware [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  757.218887] env[65478]: DEBUG nova.virt.hardware [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  757.218887] env[65478]: DEBUG nova.virt.hardware [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  757.219793] env[65478]: DEBUG oslo_vmware.service [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-03ec2f6f-da4c-4dc0-acce-4c1e7a64a34c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  757.229458] env[65478]: DEBUG oslo_vmware.service [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b8627b35-cc14-4055-aed3-0a6b60cf12ce {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  757.265546] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011561, 'name': ReconfigVM_Task, 'duration_secs': 0.592383} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  757.265546] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Reconfigured VM instance instance-00000008 to attach disk [datastore1] 95525483-b7db-427e-87b5-3f946972a250/95525483-b7db-427e-87b5-3f946972a250.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  757.265678] env[65478]: DEBUG oslo_vmware.service [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-61d2a5a8-4107-446f-9192-344a910f2509 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  757.274513] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Waiting for the task: (returnval){
[  757.274513] env[65478]:    value = "task-6011567"
[  757.274513] env[65478]:    _type = "Task"
[  757.274513] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  757.285414] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011567, 'name': Rename_Task} progress is 5%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  757.348127] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Acquiring lock "refresh_cache-06b7de0a-c338-44b8-97e7-c80281067528" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  757.348127] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Acquired lock "refresh_cache-06b7de0a-c338-44b8-97e7-c80281067528" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  757.348127] env[65478]: DEBUG nova.network.neutron [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  757.538870] env[65478]: DEBUG oslo_vmware.api [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Task: {'id': task-6011566, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.197674} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  757.539085] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  757.539229] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Deleted contents of the VM from datastore datastore2 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  757.539360] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  757.539491] env[65478]: INFO nova.compute.manager [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] [instance: c444ace8-9651-4df8-8604-982300643449] Took 1.34 seconds to destroy the instance on the hypervisor.
[  757.540070] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  757.540661] env[65478]: DEBUG nova.compute.manager [-] [instance: c444ace8-9651-4df8-8604-982300643449] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[  757.540661] env[65478]: DEBUG nova.network.neutron [-] [instance: c444ace8-9651-4df8-8604-982300643449] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[  757.540849] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  757.652311] env[65478]: INFO nova.compute.manager [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Took 19.20 seconds to build instance.
[  757.683566] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011564, 'name': CreateVM_Task, 'duration_secs': 0.667023} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  757.683566] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  757.686256] env[65478]: WARNING neutronclient.v2_0.client [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  757.686256] env[65478]: DEBUG oslo_concurrency.lockutils [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  757.686256] env[65478]: DEBUG oslo_concurrency.lockutils [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  757.686256] env[65478]: DEBUG oslo_concurrency.lockutils [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Acquired external semaphore "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  757.686256] env[65478]: DEBUG oslo_vmware.service [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-de842e03-2ce8-49ef-9874-9b15a29698ab {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  757.697958] env[65478]: DEBUG oslo_vmware.api [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Waiting for the task: (returnval){
[  757.697958] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52e2ab24-630a-ffa6-239a-35c7329c0924"
[  757.697958] env[65478]:    _type = "Task"
[  757.697958] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  757.707762] env[65478]: DEBUG oslo_vmware.api [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52e2ab24-630a-ffa6-239a-35c7329c0924, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  757.719764] env[65478]: DEBUG nova.network.neutron [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  757.789691] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011567, 'name': Rename_Task, 'duration_secs': 0.187824} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  757.790554] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  757.790824] env[65478]: DEBUG oslo_vmware.service [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-9ab01618-6a68-430d-ba90-99291e1864a1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  757.799439] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Waiting for the task: (returnval){
[  757.799439] env[65478]:    value = "task-6011568"
[  757.799439] env[65478]:    _type = "Task"
[  757.799439] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  757.810287] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011568, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  757.852903] env[65478]: WARNING neutronclient.v2_0.client [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  757.907516] env[65478]: DEBUG oslo_vmware.service [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6ae2a32d-c3d2-44ce-bae2-4b3cb89b3423 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  757.915281] env[65478]: DEBUG oslo_vmware.service [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-886a318d-6fab-49e4-a989-bbf724c5c49b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  757.951525] env[65478]: DEBUG oslo_vmware.service [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e5f4908e-c028-47b0-8a90-18f02c2d7bb8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  757.958994] env[65478]: DEBUG oslo_vmware.service [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-adc52788-a3f5-4dcc-a3a1-2941fee68790 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  757.973818] env[65478]: DEBUG nova.compute.provider_tree [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  758.145044] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  758.154590] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9c2d4d05-8f68-4477-9940-75fc6c4800db tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Lock "4f7fb80a-cb05-4bd5-bb10-380d95b2e892" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.709s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  758.208418] env[65478]: DEBUG oslo_vmware.api [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52e2ab24-630a-ffa6-239a-35c7329c0924, 'name': SearchDatastore_Task, 'duration_secs': 0.00943} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  758.208588] env[65478]: DEBUG oslo_concurrency.lockutils [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  758.208776] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  758.208964] env[65478]: DEBUG oslo_concurrency.lockutils [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  758.209085] env[65478]: DEBUG oslo_concurrency.lockutils [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  758.209253] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Creating directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  758.209461] env[65478]: DEBUG oslo_vmware.service [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-898248dd-581b-4394-86e1-fa6d4f7e90e2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  758.216762] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Created directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  758.216923] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Folder [datastore1] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  758.217671] env[65478]: DEBUG oslo_vmware.service [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-3d875d68-6c4a-4758-bc23-d5728ba2986b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  758.222686] env[65478]: DEBUG oslo_vmware.api [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Waiting for the task: (returnval){
[  758.222686] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]524921d1-7475-939c-0722-887b55b1663f"
[  758.222686] env[65478]:    _type = "Task"
[  758.222686] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  758.230191] env[65478]: DEBUG oslo_vmware.api [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]524921d1-7475-939c-0722-887b55b1663f, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  758.309981] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011568, 'name': PowerOnVM_Task} progress is 66%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  758.477199] env[65478]: DEBUG nova.scheduler.client.report [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  758.632349] env[65478]: DEBUG nova.network.neutron [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  758.732900] env[65478]: DEBUG oslo_vmware.api [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]524921d1-7475-939c-0722-887b55b1663f, 'name': SearchDatastore_Task, 'duration_secs': 0.007127} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  758.733796] env[65478]: DEBUG oslo_vmware.service [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-6f517908-c519-40cc-91f4-dbb16561c638 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  758.741812] env[65478]: DEBUG oslo_vmware.api [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Waiting for the task: (returnval){
[  758.741812] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52cc2a72-5289-d720-ce3e-d06fddd3f347"
[  758.741812] env[65478]:    _type = "Task"
[  758.741812] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  758.748049] env[65478]: DEBUG oslo_vmware.api [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52cc2a72-5289-d720-ce3e-d06fddd3f347, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  758.810021] env[65478]: DEBUG oslo_vmware.api [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011568, 'name': PowerOnVM_Task, 'duration_secs': 0.880327} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  758.810021] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  758.810021] env[65478]: DEBUG nova.compute.manager [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  758.810764] env[65478]: DEBUG oslo_vmware.service [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-2040d2ca-b723-444d-b686-4f310cf6f4a4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  758.982018] env[65478]: DEBUG oslo_concurrency.lockutils [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.394s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  758.982548] env[65478]: DEBUG nova.compute.manager [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  759.073336] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Acquiring lock "4821048b-4b5a-40b5-8888-f00dd28425d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  759.073571] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Lock "4821048b-4b5a-40b5-8888-f00dd28425d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  759.248624] env[65478]: DEBUG oslo_vmware.api [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52cc2a72-5289-d720-ce3e-d06fddd3f347, 'name': SearchDatastore_Task, 'duration_secs': 0.009622} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  759.248819] env[65478]: DEBUG oslo_concurrency.lockutils [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  759.249126] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Copying Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] eb466e5e-a499-4856-9c12-c7ca87b53230/eb466e5e-a499-4856-9c12-c7ca87b53230.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  759.249381] env[65478]: DEBUG oslo_vmware.service [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-6b9408b0-f038-450c-bd3a-df7cc1739464 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  759.255644] env[65478]: DEBUG oslo_vmware.api [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Waiting for the task: (returnval){
[  759.255644] env[65478]:    value = "task-6011569"
[  759.255644] env[65478]:    _type = "Task"
[  759.255644] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  759.263843] env[65478]: DEBUG oslo_vmware.api [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Task: {'id': task-6011569, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  759.302512] env[65478]: DEBUG nova.network.neutron [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Successfully updated port: c753d998-c733-4ef7-b4fc-008c7024f5ef {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  759.327935] env[65478]: DEBUG oslo_concurrency.lockutils [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  759.328229] env[65478]: DEBUG oslo_concurrency.lockutils [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  759.328812] env[65478]: DEBUG nova.objects.instance [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Trying to apply a migration context that does not seem to be set for this instance {{(pid=65478) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
[  759.488086] env[65478]: DEBUG nova.compute.utils [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  759.490252] env[65478]: DEBUG nova.compute.manager [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  759.492957] env[65478]: DEBUG nova.network.neutron [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  759.492957] env[65478]: WARNING neutronclient.v2_0.client [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  759.492957] env[65478]: WARNING neutronclient.v2_0.client [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  759.576064] env[65478]: DEBUG nova.compute.manager [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  759.770264] env[65478]: DEBUG oslo_vmware.api [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Task: {'id': task-6011569, 'name': CopyVirtualDisk_Task} progress is 77%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  759.805537] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Acquiring lock "refresh_cache-788343e6-5c24-4e9b-9c74-e14f3b179cdb" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  759.805713] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Acquired lock "refresh_cache-788343e6-5c24-4e9b-9c74-e14f3b179cdb" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  759.805796] env[65478]: DEBUG nova.network.neutron [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  759.998695] env[65478]: DEBUG nova.compute.manager [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  760.105647] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  760.186942] env[65478]: DEBUG nova.network.neutron [-] [instance: c444ace8-9651-4df8-8604-982300643449] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  760.267354] env[65478]: DEBUG oslo_vmware.api [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Task: {'id': task-6011569, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.547931} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  760.267803] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Copied Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] eb466e5e-a499-4856-9c12-c7ca87b53230/eb466e5e-a499-4856-9c12-c7ca87b53230.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  760.268114] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  760.268249] env[65478]: DEBUG oslo_vmware.service [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-3cbd1a5f-11d3-4a89-82a7-0eca30925526 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  760.274887] env[65478]: DEBUG oslo_vmware.api [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Waiting for the task: (returnval){
[  760.274887] env[65478]:    value = "task-6011570"
[  760.274887] env[65478]:    _type = "Task"
[  760.274887] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  760.284862] env[65478]: DEBUG oslo_vmware.api [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Task: {'id': task-6011570, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  760.338232] env[65478]: DEBUG oslo_concurrency.lockutils [None req-31dbca99-f174-4a96-91ea-d9838dd8c501 tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.010s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  760.343160] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.234s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  760.343160] env[65478]: INFO nova.compute.claims [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  760.690428] env[65478]: INFO nova.compute.manager [-] [instance: c444ace8-9651-4df8-8604-982300643449] Took 3.15 seconds to deallocate network for instance.
[  760.698825] env[65478]: DEBUG nova.policy [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b91c4271953a42e38e61d9a9b6df447f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80611f96bf484271ac3c324b95295982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  760.785508] env[65478]: DEBUG oslo_vmware.api [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Task: {'id': task-6011570, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.068856} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  760.785918] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  760.786541] env[65478]: DEBUG oslo_vmware.service [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-cf30009f-2538-4376-9c2b-8ffa44b22f9b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  760.810313] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Reconfiguring VM instance instance-0000000f to attach disk [datastore1] eb466e5e-a499-4856-9c12-c7ca87b53230/eb466e5e-a499-4856-9c12-c7ca87b53230.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  760.811254] env[65478]: DEBUG oslo_vmware.service [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-4843efa5-94a5-4c2f-8bca-f11251bf802f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  760.837127] env[65478]: DEBUG oslo_vmware.api [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Waiting for the task: (returnval){
[  760.837127] env[65478]:    value = "task-6011571"
[  760.837127] env[65478]:    _type = "Task"
[  760.837127] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  760.847154] env[65478]: DEBUG oslo_vmware.api [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Task: {'id': task-6011571, 'name': ReconfigVM_Task} progress is 5%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  761.012277] env[65478]: DEBUG nova.compute.manager [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  761.040819] env[65478]: DEBUG nova.virt.hardware [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  761.041748] env[65478]: DEBUG nova.virt.hardware [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  761.041748] env[65478]: DEBUG nova.virt.hardware [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  761.041748] env[65478]: DEBUG nova.virt.hardware [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  761.041748] env[65478]: DEBUG nova.virt.hardware [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  761.042338] env[65478]: DEBUG nova.virt.hardware [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  761.042338] env[65478]: DEBUG nova.virt.hardware [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  761.042338] env[65478]: DEBUG nova.virt.hardware [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  761.042584] env[65478]: DEBUG nova.virt.hardware [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  761.042584] env[65478]: DEBUG nova.virt.hardware [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  761.042750] env[65478]: DEBUG nova.virt.hardware [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  761.043977] env[65478]: DEBUG oslo_vmware.service [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ffefe444-2f40-4ced-9692-569f5e4fea09 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  761.053642] env[65478]: DEBUG oslo_vmware.service [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-14946734-d38b-4cc3-8d0e-c6755ae50ee1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  761.202373] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  761.348922] env[65478]: DEBUG oslo_vmware.api [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Task: {'id': task-6011571, 'name': ReconfigVM_Task, 'duration_secs': 0.492596} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  761.349192] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Reconfigured VM instance instance-0000000f to attach disk [datastore1] eb466e5e-a499-4856-9c12-c7ca87b53230/eb466e5e-a499-4856-9c12-c7ca87b53230.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  761.353033] env[65478]: DEBUG oslo_vmware.service [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-d066d39e-d814-427a-9cd2-6e584f671055 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  761.360906] env[65478]: DEBUG oslo_vmware.api [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Waiting for the task: (returnval){
[  761.360906] env[65478]:    value = "task-6011572"
[  761.360906] env[65478]:    _type = "Task"
[  761.360906] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  761.377135] env[65478]: DEBUG oslo_vmware.api [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Task: {'id': task-6011572, 'name': Rename_Task} progress is 10%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  761.445152] env[65478]: WARNING neutronclient.v2_0.client [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  761.478587] env[65478]: DEBUG nova.network.neutron [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  761.533212] env[65478]: DEBUG nova.network.neutron [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  761.658679] env[65478]: DEBUG oslo_vmware.service [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e7384858-9775-4031-b50d-660b048c6cdc {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  761.666868] env[65478]: DEBUG oslo_vmware.service [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-338d425b-e339-43b6-8068-b6a377b4340a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  761.704682] env[65478]: DEBUG oslo_vmware.service [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9e4d2aa8-a72d-46eb-9610-43140e07cf53 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  761.711779] env[65478]: DEBUG oslo_vmware.service [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-7fe33bf1-b8dc-4f61-b175-c87dc06cddeb {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  761.727603] env[65478]: DEBUG nova.compute.provider_tree [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  761.872641] env[65478]: DEBUG oslo_vmware.api [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Task: {'id': task-6011572, 'name': Rename_Task, 'duration_secs': 0.215402} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  761.872641] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  761.872641] env[65478]: DEBUG oslo_vmware.service [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-1893e14f-3bad-4ab5-8735-c8af49cfe492 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  761.877209] env[65478]: DEBUG oslo_vmware.api [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Waiting for the task: (returnval){
[  761.877209] env[65478]:    value = "task-6011573"
[  761.877209] env[65478]:    _type = "Task"
[  761.877209] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  761.886312] env[65478]: DEBUG oslo_vmware.api [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Task: {'id': task-6011573, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  762.035592] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Releasing lock "refresh_cache-06b7de0a-c338-44b8-97e7-c80281067528" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  762.035972] env[65478]: DEBUG nova.compute.manager [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[  762.036144] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  762.037250] env[65478]: DEBUG oslo_vmware.service [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-42200ae7-c580-4c4b-8cc8-ed40f711f614 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  762.047283] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  762.048496] env[65478]: DEBUG oslo_vmware.service [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-91b2e223-2fc5-4e30-aafc-383b15a1ff43 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  762.053128] env[65478]: DEBUG oslo_vmware.api [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Waiting for the task: (returnval){
[  762.053128] env[65478]:    value = "task-6011574"
[  762.053128] env[65478]:    _type = "Task"
[  762.053128] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  762.062500] env[65478]: DEBUG oslo_vmware.api [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Task: {'id': task-6011574, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  762.230996] env[65478]: DEBUG nova.scheduler.client.report [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  762.389662] env[65478]: DEBUG oslo_vmware.api [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Task: {'id': task-6011573, 'name': PowerOnVM_Task} progress is 66%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  762.526940] env[65478]: DEBUG nova.compute.manager [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Received event network-vif-plugged-2fb52993-7218-432a-bea9-5337867a80b6 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  762.532483] env[65478]: DEBUG oslo_concurrency.lockutils [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] Acquiring lock "4f7fb80a-cb05-4bd5-bb10-380d95b2e892-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  762.532635] env[65478]: DEBUG oslo_concurrency.lockutils [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] Lock "4f7fb80a-cb05-4bd5-bb10-380d95b2e892-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  762.532765] env[65478]: DEBUG oslo_concurrency.lockutils [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] Lock "4f7fb80a-cb05-4bd5-bb10-380d95b2e892-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  762.532910] env[65478]: DEBUG nova.compute.manager [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] No waiting events found dispatching network-vif-plugged-2fb52993-7218-432a-bea9-5337867a80b6 {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  762.533044] env[65478]: WARNING nova.compute.manager [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Received unexpected event network-vif-plugged-2fb52993-7218-432a-bea9-5337867a80b6 for instance with vm_state active and task_state None.
[  762.533180] env[65478]: DEBUG nova.compute.manager [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Received event network-changed-2fb52993-7218-432a-bea9-5337867a80b6 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  762.533297] env[65478]: DEBUG nova.compute.manager [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Refreshing instance network info cache due to event network-changed-2fb52993-7218-432a-bea9-5337867a80b6. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  762.533466] env[65478]: DEBUG oslo_concurrency.lockutils [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] Acquiring lock "refresh_cache-4f7fb80a-cb05-4bd5-bb10-380d95b2e892" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  762.533562] env[65478]: DEBUG oslo_concurrency.lockutils [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] Acquired lock "refresh_cache-4f7fb80a-cb05-4bd5-bb10-380d95b2e892" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  762.533679] env[65478]: DEBUG nova.network.neutron [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Refreshing network info cache for port 2fb52993-7218-432a-bea9-5337867a80b6 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  762.564903] env[65478]: DEBUG oslo_vmware.api [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Task: {'id': task-6011574, 'name': PowerOffVM_Task, 'duration_secs': 0.163554} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  762.566114] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  762.566114] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  762.566114] env[65478]: DEBUG oslo_vmware.service [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-53bbf7b8-11f0-42c6-b4b5-45c9c4c601f9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  762.594685] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  762.594836] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Deleting contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  762.594971] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Deleting the datastore file [datastore1] 06b7de0a-c338-44b8-97e7-c80281067528 {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  762.595301] env[65478]: DEBUG oslo_vmware.service [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-d5654e65-b1fe-4538-841b-664ab07b1e91 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  762.602539] env[65478]: DEBUG oslo_vmware.api [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Waiting for the task: (returnval){
[  762.602539] env[65478]:    value = "task-6011576"
[  762.602539] env[65478]:    _type = "Task"
[  762.602539] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  762.611444] env[65478]: DEBUG oslo_vmware.api [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Task: {'id': task-6011576, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  762.737923] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.399s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  762.738769] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.536s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  762.738981] env[65478]: DEBUG nova.objects.instance [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Lazy-loading 'resources' on Instance uuid c444ace8-9651-4df8-8604-982300643449 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  762.741898] env[65478]: DEBUG nova.compute.manager [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  762.840574] env[65478]: DEBUG nova.network.neutron [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Successfully created port: b7d6d7e2-7876-4997-af0e-f826ba3ca090 {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  762.891334] env[65478]: DEBUG oslo_vmware.api [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Task: {'id': task-6011573, 'name': PowerOnVM_Task, 'duration_secs': 0.703624} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  762.891689] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  762.891689] env[65478]: INFO nova.compute.manager [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Took 12.47 seconds to spawn the instance on the hypervisor.
[  762.891824] env[65478]: DEBUG nova.compute.manager [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  762.893103] env[65478]: DEBUG oslo_vmware.service [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4832f705-12d2-435e-b402-a6bae39bd614 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  763.036740] env[65478]: WARNING neutronclient.v2_0.client [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  763.112609] env[65478]: DEBUG oslo_vmware.api [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Task: {'id': task-6011576, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.108895} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  763.112609] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  763.112609] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Deleted contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  763.112918] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  763.112960] env[65478]: INFO nova.compute.manager [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Took 1.08 seconds to destroy the instance on the hypervisor.
[  763.113612] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  763.113994] env[65478]: DEBUG nova.compute.manager [-] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[  763.113994] env[65478]: DEBUG nova.network.neutron [-] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[  763.115061] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  763.255682] env[65478]: DEBUG nova.compute.utils [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  763.256926] env[65478]: DEBUG nova.compute.manager [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  763.257200] env[65478]: DEBUG nova.network.neutron [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  763.257592] env[65478]: WARNING neutronclient.v2_0.client [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  763.258021] env[65478]: WARNING neutronclient.v2_0.client [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  763.419680] env[65478]: INFO nova.compute.manager [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Took 17.43 seconds to build instance.
[  763.531124] env[65478]: DEBUG oslo_vmware.service [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-38cc6b61-fd56-4a26-acd5-bbc6be7d5030 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  763.541250] env[65478]: DEBUG oslo_vmware.service [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6c6b537e-5e0a-45da-828e-eeddb5b9c1cd {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  763.582255] env[65478]: DEBUG oslo_vmware.service [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e3535e60-3061-4998-9ccb-8060808aa1a7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  763.588956] env[65478]: DEBUG oslo_vmware.service [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-fc5648db-14e1-41bd-ad29-3a3e35d5c568 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  763.602800] env[65478]: DEBUG nova.compute.provider_tree [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  763.761885] env[65478]: DEBUG nova.compute.manager [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  763.788955] env[65478]: DEBUG nova.network.neutron [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Updating instance_info_cache with network_info: [{"id": "5c9a8578-bb94-4d72-acef-25b60278df21", "address": "fa:16:3e:ae:3e:c3", "network": {"id": "f4cdd871-29d3-4e5f-9c28-ce69831a9d5b", "bridge": "br-int", "label": "tempest-FloatingIPsAssociationNegativeTestJSON-434449668-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99bc07d4a2be4da3b5bb4900ea76450b", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "c68b7663-4f0e-47f0-ac7f-40c6d952f7bb", "external-id": "nsx-vlan-transportzone-696", "segmentation_id": 696, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap5c9a8578-bb", "ovs_interfaceid": "5c9a8578-bb94-4d72-acef-25b60278df21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  763.853421] env[65478]: DEBUG nova.network.neutron [-] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  763.853421] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  763.899446] env[65478]: DEBUG nova.policy [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64c2641c605e415e8cbb7422a4ce7bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c31211e0004fe78fab62e554754271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  763.923030] env[65478]: DEBUG oslo_concurrency.lockutils [None req-718d790d-9950-432a-a691-0152edeeae74 tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Lock "eb466e5e-a499-4856-9c12-c7ca87b53230" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.941s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  764.106375] env[65478]: DEBUG nova.scheduler.client.report [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  764.292655] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Releasing lock "refresh_cache-eb076624-c76c-47da-9320-5fc13a51b365" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  764.292655] env[65478]: DEBUG nova.compute.manager [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Instance network_info: |[{"id": "5c9a8578-bb94-4d72-acef-25b60278df21", "address": "fa:16:3e:ae:3e:c3", "network": {"id": "f4cdd871-29d3-4e5f-9c28-ce69831a9d5b", "bridge": "br-int", "label": "tempest-FloatingIPsAssociationNegativeTestJSON-434449668-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99bc07d4a2be4da3b5bb4900ea76450b", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "c68b7663-4f0e-47f0-ac7f-40c6d952f7bb", "external-id": "nsx-vlan-transportzone-696", "segmentation_id": 696, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap5c9a8578-bb", "ovs_interfaceid": "5c9a8578-bb94-4d72-acef-25b60278df21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  764.293152] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:ae:3e:c3', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': 'c68b7663-4f0e-47f0-ac7f-40c6d952f7bb', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': '5c9a8578-bb94-4d72-acef-25b60278df21', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  764.306317] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Creating folder: Project (99bc07d4a2be4da3b5bb4900ea76450b). Parent ref: group-v1161186. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  764.306876] env[65478]: DEBUG oslo_vmware.service [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-9abb4c9f-9857-4cbf-9c76-41857e02ee98 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  764.317772] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Created folder: Project (99bc07d4a2be4da3b5bb4900ea76450b) in parent group-v1161186.
[  764.317954] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Creating folder: Instances. Parent ref: group-v1161231. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  764.318260] env[65478]: DEBUG oslo_vmware.service [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-4233d82d-92c1-4ba0-b145-4c8c52d34124 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  764.328512] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Created folder: Instances in parent group-v1161231.
[  764.329765] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  764.330251] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  764.330563] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-bda4824b-1291-4775-85a3-9f09edd15a55 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  764.356951] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  764.356951] env[65478]:    value = "task-6011579"
[  764.356951] env[65478]:    _type = "Task"
[  764.356951] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  764.361324] env[65478]: DEBUG nova.network.neutron [-] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  764.367270] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011579, 'name': CreateVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  764.610904] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.873s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  764.640157] env[65478]: INFO nova.scheduler.client.report [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Deleted allocations for instance c444ace8-9651-4df8-8604-982300643449
[  764.773752] env[65478]: DEBUG nova.compute.manager [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  764.809283] env[65478]: DEBUG nova.virt.hardware [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  764.809485] env[65478]: DEBUG nova.virt.hardware [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  764.809595] env[65478]: DEBUG nova.virt.hardware [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  764.809740] env[65478]: DEBUG nova.virt.hardware [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  764.809840] env[65478]: DEBUG nova.virt.hardware [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  764.809989] env[65478]: DEBUG nova.virt.hardware [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  764.815578] env[65478]: DEBUG nova.virt.hardware [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  764.815578] env[65478]: DEBUG nova.virt.hardware [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  764.815729] env[65478]: DEBUG nova.virt.hardware [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  764.815777] env[65478]: DEBUG nova.virt.hardware [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  764.815893] env[65478]: DEBUG nova.virt.hardware [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  764.818497] env[65478]: DEBUG oslo_vmware.service [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3af1ab31-3ba7-43fa-8d32-620547740314 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  764.832462] env[65478]: DEBUG oslo_vmware.service [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ed4e7686-f1d4-417f-885b-4f627f72e93f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  764.871269] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011579, 'name': CreateVM_Task, 'duration_secs': 0.320009} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  764.871539] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  764.872266] env[65478]: INFO nova.compute.manager [-] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Took 1.76 seconds to deallocate network for instance.
[  764.875018] env[65478]: WARNING neutronclient.v2_0.client [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  764.875550] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  764.880096] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  764.880390] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Acquired external semaphore "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  764.881188] env[65478]: DEBUG oslo_vmware.service [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-2a349d4c-1fee-4722-9736-9454b2fd5baf {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  764.886087] env[65478]: DEBUG oslo_vmware.api [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Waiting for the task: (returnval){
[  764.886087] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52953fab-d34a-b28d-20b3-dabffbf75e54"
[  764.886087] env[65478]:    _type = "Task"
[  764.886087] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  764.898272] env[65478]: DEBUG oslo_vmware.api [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52953fab-d34a-b28d-20b3-dabffbf75e54, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  764.943234] env[65478]: DEBUG nova.network.neutron [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Successfully updated port: b7d6d7e2-7876-4997-af0e-f826ba3ca090 {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  764.996638] env[65478]: WARNING neutronclient.v2_0.client [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  765.149573] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a199b0f2-24c4-4924-a0fd-2f65f7b749eb tempest-ServerDiagnosticsNegativeTest-1622006178 tempest-ServerDiagnosticsNegativeTest-1622006178-project-member] Lock "c444ace8-9651-4df8-8604-982300643449" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.460s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  765.382250] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  765.382453] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  765.382630] env[65478]: DEBUG nova.objects.instance [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Lazy-loading 'resources' on Instance uuid 06b7de0a-c338-44b8-97e7-c80281067528 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  765.400793] env[65478]: DEBUG oslo_vmware.api [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52953fab-d34a-b28d-20b3-dabffbf75e54, 'name': SearchDatastore_Task, 'duration_secs': 0.009019} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  765.401779] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  765.401998] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  765.402244] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  765.402361] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  765.402470] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Creating directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  765.402748] env[65478]: DEBUG oslo_vmware.service [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-522b0c22-437a-46b1-86cf-6edd0e0aa194 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  765.413293] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Created directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  765.413293] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Folder [datastore1] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  765.413490] env[65478]: DEBUG oslo_vmware.service [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-fa4633e6-3198-462b-a31a-d0bd6f237dad {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  765.420936] env[65478]: DEBUG oslo_vmware.api [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Waiting for the task: (returnval){
[  765.420936] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]5220f1bd-0c74-9ecb-4eb6-12b3f7deeab6"
[  765.420936] env[65478]:    _type = "Task"
[  765.420936] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  765.425837] env[65478]: DEBUG nova.network.neutron [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Successfully created port: e599424e-fe74-4d2c-948c-3759b6289f44 {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  765.433105] env[65478]: DEBUG oslo_vmware.api [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5220f1bd-0c74-9ecb-4eb6-12b3f7deeab6, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  765.447811] env[65478]: DEBUG oslo_concurrency.lockutils [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Acquiring lock "refresh_cache-f01c577a-3995-465a-98ae-21880df54cc0" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  765.447946] env[65478]: DEBUG oslo_concurrency.lockutils [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Acquired lock "refresh_cache-f01c577a-3995-465a-98ae-21880df54cc0" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  765.448108] env[65478]: DEBUG nova.network.neutron [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  765.860388] env[65478]: DEBUG nova.network.neutron [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Updating instance_info_cache with network_info: [{"id": "c753d998-c733-4ef7-b4fc-008c7024f5ef", "address": "fa:16:3e:18:92:82", "network": {"id": "8419dcc5-ccb7-4667-a5ee-3f07016ddecd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "eb20b7ec77e847179c9940510a8b48bf", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "ec3f9e71-839a-429d-b211-d3dfc98ca4f6", "external-id": "nsx-vlan-transportzone-5", "segmentation_id": 5, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapc753d998-c7", "ovs_interfaceid": "c753d998-c733-4ef7-b4fc-008c7024f5ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  765.942164] env[65478]: DEBUG oslo_vmware.api [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5220f1bd-0c74-9ecb-4eb6-12b3f7deeab6, 'name': SearchDatastore_Task, 'duration_secs': 0.013514} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  765.942968] env[65478]: DEBUG oslo_vmware.service [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-389aebf7-b154-4997-a7d2-05cc6c53dabb {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  765.955324] env[65478]: DEBUG oslo_vmware.api [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Waiting for the task: (returnval){
[  765.955324] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52603bce-620f-e8e7-aea6-31a9e349a2e3"
[  765.955324] env[65478]:    _type = "Task"
[  765.955324] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  765.974870] env[65478]: DEBUG oslo_vmware.api [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52603bce-620f-e8e7-aea6-31a9e349a2e3, 'name': SearchDatastore_Task, 'duration_secs': 0.00957} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  765.980047] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  765.980125] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Copying Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] eb076624-c76c-47da-9320-5fc13a51b365/eb076624-c76c-47da-9320-5fc13a51b365.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  765.980996] env[65478]: DEBUG oslo_vmware.service [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-04e29179-75f5-4147-aeb2-5a3b824ec6f3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  765.990340] env[65478]: DEBUG oslo_vmware.api [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Waiting for the task: (returnval){
[  765.990340] env[65478]:    value = "task-6011580"
[  765.990340] env[65478]:    _type = "Task"
[  765.990340] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  766.005424] env[65478]: DEBUG oslo_vmware.api [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Task: {'id': task-6011580, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  766.010112] env[65478]: WARNING neutronclient.v2_0.client [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  766.057537] env[65478]: DEBUG nova.network.neutron [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  766.238532] env[65478]: DEBUG nova.network.neutron [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Updated VIF entry in instance network info cache for port 2fb52993-7218-432a-bea9-5337867a80b6. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  766.239058] env[65478]: DEBUG nova.network.neutron [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Updating instance_info_cache with network_info: [{"id": "2fb52993-7218-432a-bea9-5337867a80b6", "address": "fa:16:3e:d1:9e:61", "network": {"id": "2ed010d6-4573-4056-a189-22d86fca4369", "bridge": "br-int", "label": "tempest-ServersWithSpecificFlavorTestJSON-2103777099-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "70efc035843c47d69ec6a42f446a2b91", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "b250e561-3be3-4bae-be1a-162251b1ee31", "external-id": "nsx-vlan-transportzone-464", "segmentation_id": 464, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap2fb52993-72", "ovs_interfaceid": "2fb52993-7218-432a-bea9-5337867a80b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  766.338511] env[65478]: DEBUG oslo_vmware.service [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3418a660-1f0f-4961-af4f-408be14ab37a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  766.357665] env[65478]: DEBUG oslo_vmware.service [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-75b227a6-5d9f-4491-9391-4e97c873ced3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  766.367181] env[65478]: WARNING neutronclient.v2_0.client [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  766.385153] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Releasing lock "refresh_cache-788343e6-5c24-4e9b-9c74-e14f3b179cdb" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  766.394835] env[65478]: DEBUG nova.compute.manager [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Instance network_info: |[{"id": "c753d998-c733-4ef7-b4fc-008c7024f5ef", "address": "fa:16:3e:18:92:82", "network": {"id": "8419dcc5-ccb7-4667-a5ee-3f07016ddecd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "eb20b7ec77e847179c9940510a8b48bf", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "ec3f9e71-839a-429d-b211-d3dfc98ca4f6", "external-id": "nsx-vlan-transportzone-5", "segmentation_id": 5, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapc753d998-c7", "ovs_interfaceid": "c753d998-c733-4ef7-b4fc-008c7024f5ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  766.415704] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:18:92:82', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': 'ec3f9e71-839a-429d-b211-d3dfc98ca4f6', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': 'c753d998-c733-4ef7-b4fc-008c7024f5ef', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  766.432377] env[65478]: DEBUG oslo_vmware.service [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-353a767c-90e3-4417-841f-9076d6c08008 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  766.446197] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  766.448499] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  766.459181] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-9cf279bd-554d-4936-bc3c-e967f0aa1724 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  766.474125] env[65478]: DEBUG oslo_vmware.service [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-281abdd6-b941-401f-9b0c-0905eece4b88 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  766.527104] env[65478]: DEBUG oslo_vmware.api [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Task: {'id': task-6011580, 'name': CopyVirtualDisk_Task} progress is 77%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  766.530854] env[65478]: DEBUG nova.compute.provider_tree [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  766.536335] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  766.536335] env[65478]:    value = "task-6011581"
[  766.536335] env[65478]:    _type = "Task"
[  766.536335] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  766.543756] env[65478]: DEBUG nova.compute.manager [req-6d33aea1-fcf1-41e9-b925-eeed1176edf3 req-54854277-81f7-44c4-be49-1e42c233cf6d service nova] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Received event network-changed-77d4d422-ea65-4577-ae8a-77615259cfb1 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  766.545758] env[65478]: DEBUG nova.compute.manager [req-6d33aea1-fcf1-41e9-b925-eeed1176edf3 req-54854277-81f7-44c4-be49-1e42c233cf6d service nova] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Refreshing instance network info cache due to event network-changed-77d4d422-ea65-4577-ae8a-77615259cfb1. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  766.545758] env[65478]: DEBUG oslo_concurrency.lockutils [req-6d33aea1-fcf1-41e9-b925-eeed1176edf3 req-54854277-81f7-44c4-be49-1e42c233cf6d service nova] Acquiring lock "refresh_cache-e4810749-aefd-411e-87c1-5b1b1967538f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  766.549524] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011581, 'name': CreateVM_Task} progress is 15%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  766.550227] env[65478]: DEBUG oslo_concurrency.lockutils [req-6d33aea1-fcf1-41e9-b925-eeed1176edf3 req-54854277-81f7-44c4-be49-1e42c233cf6d service nova] Acquired lock "refresh_cache-e4810749-aefd-411e-87c1-5b1b1967538f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  766.550638] env[65478]: DEBUG nova.network.neutron [req-6d33aea1-fcf1-41e9-b925-eeed1176edf3 req-54854277-81f7-44c4-be49-1e42c233cf6d service nova] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Refreshing network info cache for port 77d4d422-ea65-4577-ae8a-77615259cfb1 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  766.648703] env[65478]: DEBUG nova.network.neutron [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Updating instance_info_cache with network_info: [{"id": "b7d6d7e2-7876-4997-af0e-f826ba3ca090", "address": "fa:16:3e:c1:b1:be", "network": {"id": "31194553-028e-4d05-9ab4-3398c78882fd", "bridge": "br-int", "label": "tempest-ImagesNegativeTestJSON-1509320111-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80611f96bf484271ac3c324b95295982", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "5e1049e8-c06b-4c93-a9e1-2cbb530f3f95", "external-id": "nsx-vlan-transportzone-966", "segmentation_id": 966, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapb7d6d7e2-78", "ovs_interfaceid": "b7d6d7e2-7876-4997-af0e-f826ba3ca090", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  766.745505] env[65478]: DEBUG oslo_concurrency.lockutils [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] Releasing lock "refresh_cache-4f7fb80a-cb05-4bd5-bb10-380d95b2e892" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  766.745732] env[65478]: DEBUG nova.compute.manager [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Received event network-changed-09df3109-08b1-49d4-8a44-1f111fb53582 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  766.745858] env[65478]: DEBUG nova.compute.manager [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Refreshing instance network info cache due to event network-changed-09df3109-08b1-49d4-8a44-1f111fb53582. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  766.746037] env[65478]: DEBUG oslo_concurrency.lockutils [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] Acquiring lock "refresh_cache-78246782-d2a2-4819-8924-51764ffe05aa" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  766.746169] env[65478]: DEBUG oslo_concurrency.lockutils [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] Acquired lock "refresh_cache-78246782-d2a2-4819-8924-51764ffe05aa" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  766.746305] env[65478]: DEBUG nova.network.neutron [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Refreshing network info cache for port 09df3109-08b1-49d4-8a44-1f111fb53582 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  766.800538] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Acquiring lock "d978e71d-2c30-4a76-b000-6ddf3203ab10" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  766.800747] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Lock "d978e71d-2c30-4a76-b000-6ddf3203ab10" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  767.007628] env[65478]: DEBUG oslo_vmware.api [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Task: {'id': task-6011580, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.54422} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  767.007908] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Copied Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] eb076624-c76c-47da-9320-5fc13a51b365/eb076624-c76c-47da-9320-5fc13a51b365.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  767.008036] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  767.008366] env[65478]: DEBUG oslo_vmware.service [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-fabebf6e-d626-4b39-84ef-3d96e224f203 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  767.016542] env[65478]: DEBUG oslo_vmware.api [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Waiting for the task: (returnval){
[  767.016542] env[65478]:    value = "task-6011582"
[  767.016542] env[65478]:    _type = "Task"
[  767.016542] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  767.026576] env[65478]: DEBUG oslo_vmware.api [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Task: {'id': task-6011582, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  767.047650] env[65478]: DEBUG nova.scheduler.client.report [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  767.056921] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011581, 'name': CreateVM_Task} progress is 99%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  767.058508] env[65478]: WARNING neutronclient.v2_0.client [req-6d33aea1-fcf1-41e9-b925-eeed1176edf3 req-54854277-81f7-44c4-be49-1e42c233cf6d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  767.154135] env[65478]: DEBUG oslo_concurrency.lockutils [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Releasing lock "refresh_cache-f01c577a-3995-465a-98ae-21880df54cc0" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  767.154497] env[65478]: DEBUG nova.compute.manager [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Instance network_info: |[{"id": "b7d6d7e2-7876-4997-af0e-f826ba3ca090", "address": "fa:16:3e:c1:b1:be", "network": {"id": "31194553-028e-4d05-9ab4-3398c78882fd", "bridge": "br-int", "label": "tempest-ImagesNegativeTestJSON-1509320111-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80611f96bf484271ac3c324b95295982", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "5e1049e8-c06b-4c93-a9e1-2cbb530f3f95", "external-id": "nsx-vlan-transportzone-966", "segmentation_id": 966, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapb7d6d7e2-78", "ovs_interfaceid": "b7d6d7e2-7876-4997-af0e-f826ba3ca090", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  767.155160] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:c1:b1:be', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': '5e1049e8-c06b-4c93-a9e1-2cbb530f3f95', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': 'b7d6d7e2-7876-4997-af0e-f826ba3ca090', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  767.163517] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Creating folder: Project (80611f96bf484271ac3c324b95295982). Parent ref: group-v1161186. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  767.163898] env[65478]: DEBUG oslo_vmware.service [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-481b158d-8a5b-410b-870e-abc4dc9a04e1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  767.173845] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Created folder: Project (80611f96bf484271ac3c324b95295982) in parent group-v1161186.
[  767.174057] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Creating folder: Instances. Parent ref: group-v1161235. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  767.174539] env[65478]: DEBUG oslo_vmware.service [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-627b03a2-af4c-48b8-a2ed-466a360068e4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  767.184133] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Created folder: Instances in parent group-v1161235.
[  767.184501] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  767.185095] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  767.185403] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-30962aa9-4ee1-4a53-b2ae-807742e62bc8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  767.208195] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  767.208195] env[65478]:    value = "task-6011585"
[  767.208195] env[65478]:    _type = "Task"
[  767.208195] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  767.217583] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011585, 'name': CreateVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  767.251707] env[65478]: WARNING neutronclient.v2_0.client [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  767.299773] env[65478]: DEBUG nova.network.neutron [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Successfully updated port: e599424e-fe74-4d2c-948c-3759b6289f44 {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  767.306636] env[65478]: DEBUG nova.compute.manager [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  767.469540] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "db37d828-c474-4577-816b-6fb2fcd9a82b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  767.471973] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "db37d828-c474-4577-816b-6fb2fcd9a82b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  767.530110] env[65478]: DEBUG oslo_vmware.api [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Task: {'id': task-6011582, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.082012} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  767.530359] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  767.531290] env[65478]: DEBUG oslo_vmware.service [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ef958e18-ec16-4087-9216-a87e673f403e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  767.558757] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.176s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  767.574862] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Reconfiguring VM instance instance-00000010 to attach disk [datastore1] eb076624-c76c-47da-9320-5fc13a51b365/eb076624-c76c-47da-9320-5fc13a51b365.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  767.574862] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011581, 'name': CreateVM_Task, 'duration_secs': 0.60006} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  767.576788] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  767.576788] env[65478]: DEBUG oslo_vmware.service [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-fb2e4d10-c899-4e40-a4c1-2ac37f6804a1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  767.582779] env[65478]: WARNING neutronclient.v2_0.client [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  767.583178] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Acquiring lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  767.596908] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Acquired lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  767.600501] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Acquired external semaphore "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  767.601059] env[65478]: DEBUG oslo_vmware.service [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-f0624ebb-c156-4ad7-b0fe-2970f7714f1a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  767.605081] env[65478]: DEBUG oslo_vmware.api [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Waiting for the task: (returnval){
[  767.605081] env[65478]:    value = "task-6011586"
[  767.605081] env[65478]:    _type = "Task"
[  767.605081] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  767.610849] env[65478]: DEBUG oslo_vmware.api [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Waiting for the task: (returnval){
[  767.610849] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52f187b2-cee6-811f-bf7e-0c6e914e2ea9"
[  767.610849] env[65478]:    _type = "Task"
[  767.610849] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  767.621809] env[65478]: DEBUG oslo_vmware.api [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52f187b2-cee6-811f-bf7e-0c6e914e2ea9, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  767.626052] env[65478]: DEBUG oslo_vmware.api [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Task: {'id': task-6011586, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  767.627257] env[65478]: INFO nova.scheduler.client.report [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Deleted allocations for instance 06b7de0a-c338-44b8-97e7-c80281067528
[  767.723313] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011585, 'name': CreateVM_Task} progress is 25%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  767.804823] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Acquiring lock "refresh_cache-4821048b-4b5a-40b5-8888-f00dd28425d1" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  767.804823] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Acquired lock "refresh_cache-4821048b-4b5a-40b5-8888-f00dd28425d1" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  767.804823] env[65478]: DEBUG nova.network.neutron [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  767.834620] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  767.834856] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  767.836625] env[65478]: INFO nova.compute.claims [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  767.977517] env[65478]: DEBUG nova.compute.manager [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  768.127477] env[65478]: DEBUG oslo_vmware.api [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52f187b2-cee6-811f-bf7e-0c6e914e2ea9, 'name': SearchDatastore_Task, 'duration_secs': 0.014041} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  768.128470] env[65478]: DEBUG oslo_vmware.api [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Task: {'id': task-6011586, 'name': ReconfigVM_Task} progress is 99%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  768.128684] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Releasing lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  768.128807] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  768.129031] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Acquiring lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  768.129162] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Acquired lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  768.129314] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Creating directory with path [datastore2] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  768.129641] env[65478]: DEBUG oslo_vmware.service [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-cc5734a5-1eb5-4be5-b0ca-ad345c66a552 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  768.136733] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a867e1a3-298f-4741-a838-ba807af953de tempest-ServerDiagnosticsV248Test-400809918 tempest-ServerDiagnosticsV248Test-400809918-project-member] Lock "06b7de0a-c338-44b8-97e7-c80281067528" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.302s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  768.138161] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Created directory with path [datastore2] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  768.138564] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Folder [datastore2] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  768.139450] env[65478]: DEBUG oslo_vmware.service [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-e5250254-801e-44c1-bc34-ee750cbd1e41 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  768.150289] env[65478]: DEBUG oslo_vmware.api [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Waiting for the task: (returnval){
[  768.150289] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52223b6a-70d7-e727-8470-9163bfe0d068"
[  768.150289] env[65478]:    _type = "Task"
[  768.150289] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  768.166672] env[65478]: DEBUG oslo_vmware.api [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52223b6a-70d7-e727-8470-9163bfe0d068, 'name': SearchDatastore_Task, 'duration_secs': 0.0095} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  768.167827] env[65478]: DEBUG oslo_vmware.service [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-4165b1ea-48ca-457a-b566-51edb592244a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  768.177835] env[65478]: DEBUG oslo_vmware.api [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Waiting for the task: (returnval){
[  768.177835] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c63bb5-5ce9-d708-533f-896e8b286153"
[  768.177835] env[65478]:    _type = "Task"
[  768.177835] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  768.187529] env[65478]: DEBUG oslo_vmware.api [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c63bb5-5ce9-d708-533f-896e8b286153, 'name': SearchDatastore_Task, 'duration_secs': 0.008751} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  768.187738] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Releasing lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  768.187941] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Copying Virtual Disk [datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore2] 788343e6-5c24-4e9b-9c74-e14f3b179cdb/788343e6-5c24-4e9b-9c74-e14f3b179cdb.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  768.188213] env[65478]: DEBUG oslo_vmware.service [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-ca356c33-13af-469b-8468-1dea706a5763 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  768.194970] env[65478]: DEBUG oslo_vmware.api [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Waiting for the task: (returnval){
[  768.194970] env[65478]:    value = "task-6011587"
[  768.194970] env[65478]:    _type = "Task"
[  768.194970] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  768.202903] env[65478]: DEBUG oslo_vmware.api [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011587, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  768.218759] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011585, 'name': CreateVM_Task, 'duration_secs': 0.6457} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  768.219540] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  768.220257] env[65478]: WARNING neutronclient.v2_0.client [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  768.220609] env[65478]: DEBUG oslo_concurrency.lockutils [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Acquiring lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  768.220722] env[65478]: DEBUG oslo_concurrency.lockutils [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Acquired lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  768.220997] env[65478]: DEBUG oslo_concurrency.lockutils [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Acquired external semaphore "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  768.221332] env[65478]: DEBUG oslo_vmware.service [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-fd074288-06f8-403b-a779-718d35f65cd6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  768.226329] env[65478]: DEBUG oslo_vmware.api [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Waiting for the task: (returnval){
[  768.226329] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52974432-0809-e00f-9a06-1f70a1f36156"
[  768.226329] env[65478]:    _type = "Task"
[  768.226329] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  768.235877] env[65478]: DEBUG oslo_vmware.api [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52974432-0809-e00f-9a06-1f70a1f36156, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  768.243348] env[65478]: WARNING neutronclient.v2_0.client [req-6d33aea1-fcf1-41e9-b925-eeed1176edf3 req-54854277-81f7-44c4-be49-1e42c233cf6d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  768.276327] env[65478]: WARNING neutronclient.v2_0.client [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  768.428187] env[65478]: DEBUG nova.network.neutron [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  768.475377] env[65478]: DEBUG nova.network.neutron [req-6d33aea1-fcf1-41e9-b925-eeed1176edf3 req-54854277-81f7-44c4-be49-1e42c233cf6d service nova] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Updated VIF entry in instance network info cache for port 77d4d422-ea65-4577-ae8a-77615259cfb1. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  768.475943] env[65478]: DEBUG nova.network.neutron [req-6d33aea1-fcf1-41e9-b925-eeed1176edf3 req-54854277-81f7-44c4-be49-1e42c233cf6d service nova] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Updating instance_info_cache with network_info: [{"id": "77d4d422-ea65-4577-ae8a-77615259cfb1", "address": "fa:16:3e:52:95:56", "network": {"id": "684d3d46-b7f8-44e4-b8ff-51b0a8c27a1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-600899984-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "10.180.180.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "88b6f91cedac41a6aeb3e367dace092b", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "5ba07329-1d3e-4ba8-8774-d029262318c4", "external-id": "nsx-vlan-transportzone-534", "segmentation_id": 534, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap77d4d422-ea", "ovs_interfaceid": "77d4d422-ea65-4577-ae8a-77615259cfb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  768.487349] env[65478]: DEBUG nova.network.neutron [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Updated VIF entry in instance network info cache for port 09df3109-08b1-49d4-8a44-1f111fb53582. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  768.487349] env[65478]: DEBUG nova.network.neutron [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Updating instance_info_cache with network_info: [{"id": "09df3109-08b1-49d4-8a44-1f111fb53582", "address": "fa:16:3e:3f:50:90", "network": {"id": "9610848f-7672-478c-9481-ef6d9198af46", "bridge": "br-int", "label": "tempest-ServersTestFqdnHostnames-142105796-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "10.180.180.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "81a0ae95d73f4678b203b7db9a0d36a7", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "8c3e2368-4a35-4aa5-9135-23daedbbf9ef", "external-id": "nsx-vlan-transportzone-125", "segmentation_id": 125, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap09df3109-08", "ovs_interfaceid": "09df3109-08b1-49d4-8a44-1f111fb53582", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  768.517250] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  768.564517] env[65478]: WARNING neutronclient.v2_0.client [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  768.628209] env[65478]: DEBUG oslo_vmware.api [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Task: {'id': task-6011586, 'name': ReconfigVM_Task, 'duration_secs': 0.523891} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  768.629539] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Reconfigured VM instance instance-00000010 to attach disk [datastore1] eb076624-c76c-47da-9320-5fc13a51b365/eb076624-c76c-47da-9320-5fc13a51b365.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  768.629539] env[65478]: DEBUG oslo_vmware.service [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-f8fd0899-9ac6-4845-9487-a661331dad05 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  768.642169] env[65478]: DEBUG oslo_vmware.api [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Waiting for the task: (returnval){
[  768.642169] env[65478]:    value = "task-6011588"
[  768.642169] env[65478]:    _type = "Task"
[  768.642169] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  768.655039] env[65478]: DEBUG oslo_vmware.api [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Task: {'id': task-6011588, 'name': Rename_Task} progress is 10%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  768.704313] env[65478]: DEBUG nova.network.neutron [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Updating instance_info_cache with network_info: [{"id": "e599424e-fe74-4d2c-948c-3759b6289f44", "address": "fa:16:3e:c1:84:26", "network": {"id": "386793de-d2e2-4c26-8cab-60dbf2a2ffe3", "bridge": "br-int", "label": "tempest-InstanceActionsTestJSON-2039284656-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60c31211e0004fe78fab62e554754271", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "50886eea-591a-452c-a27b-5f22cfc9df85", "external-id": "nsx-vlan-transportzone-578", "segmentation_id": 578, "bound_drivers": {"0": "nsxv3"}}, "devname": "tape599424e-fe", "ovs_interfaceid": "e599424e-fe74-4d2c-948c-3759b6289f44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  768.717620] env[65478]: DEBUG oslo_vmware.api [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011587, 'name': CopyVirtualDisk_Task} progress is 77%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  768.741794] env[65478]: DEBUG oslo_vmware.api [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52974432-0809-e00f-9a06-1f70a1f36156, 'name': SearchDatastore_Task, 'duration_secs': 0.00905} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  768.742104] env[65478]: DEBUG oslo_concurrency.lockutils [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Releasing lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  768.742547] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  768.744230] env[65478]: DEBUG oslo_concurrency.lockutils [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Acquiring lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  768.744230] env[65478]: DEBUG oslo_concurrency.lockutils [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Acquired lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  768.744230] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Creating directory with path [datastore2] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  768.744230] env[65478]: DEBUG oslo_vmware.service [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-36c1c6c0-9b23-471d-a276-08477779cddb {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  768.753704] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Created directory with path [datastore2] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  768.753949] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Folder [datastore2] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  768.754858] env[65478]: DEBUG oslo_vmware.service [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-ee7b615c-f9f6-430e-af6e-2a6c5cdd7239 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  768.761658] env[65478]: DEBUG oslo_vmware.api [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Waiting for the task: (returnval){
[  768.761658] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52eee525-371e-9ae6-d2be-12c4f813744a"
[  768.761658] env[65478]:    _type = "Task"
[  768.761658] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  768.773321] env[65478]: DEBUG oslo_vmware.api [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52eee525-371e-9ae6-d2be-12c4f813744a, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  768.979674] env[65478]: DEBUG oslo_concurrency.lockutils [req-6d33aea1-fcf1-41e9-b925-eeed1176edf3 req-54854277-81f7-44c4-be49-1e42c233cf6d service nova] Releasing lock "refresh_cache-e4810749-aefd-411e-87c1-5b1b1967538f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  768.991159] env[65478]: DEBUG oslo_concurrency.lockutils [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] Releasing lock "refresh_cache-78246782-d2a2-4819-8924-51764ffe05aa" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  768.991599] env[65478]: DEBUG nova.compute.manager [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Received event network-vif-plugged-fe1047e6-be6d-4718-a53e-e21e2b96dcc9 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  768.991791] env[65478]: DEBUG oslo_concurrency.lockutils [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] Acquiring lock "eb466e5e-a499-4856-9c12-c7ca87b53230-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  768.991954] env[65478]: DEBUG oslo_concurrency.lockutils [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] Lock "eb466e5e-a499-4856-9c12-c7ca87b53230-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  768.992111] env[65478]: DEBUG oslo_concurrency.lockutils [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] Lock "eb466e5e-a499-4856-9c12-c7ca87b53230-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  768.992206] env[65478]: DEBUG nova.compute.manager [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] No waiting events found dispatching network-vif-plugged-fe1047e6-be6d-4718-a53e-e21e2b96dcc9 {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  768.992357] env[65478]: WARNING nova.compute.manager [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Received unexpected event network-vif-plugged-fe1047e6-be6d-4718-a53e-e21e2b96dcc9 for instance with vm_state building and task_state spawning.
[  768.992789] env[65478]: DEBUG nova.compute.manager [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Received event network-changed-fe1047e6-be6d-4718-a53e-e21e2b96dcc9 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  768.994449] env[65478]: DEBUG nova.compute.manager [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Refreshing instance network info cache due to event network-changed-fe1047e6-be6d-4718-a53e-e21e2b96dcc9. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  768.994635] env[65478]: DEBUG oslo_concurrency.lockutils [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] Acquiring lock "refresh_cache-eb466e5e-a499-4856-9c12-c7ca87b53230" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  768.997639] env[65478]: DEBUG oslo_concurrency.lockutils [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] Acquired lock "refresh_cache-eb466e5e-a499-4856-9c12-c7ca87b53230" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  768.997872] env[65478]: DEBUG nova.network.neutron [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Refreshing network info cache for port fe1047e6-be6d-4718-a53e-e21e2b96dcc9 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  769.160601] env[65478]: DEBUG oslo_vmware.api [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Task: {'id': task-6011588, 'name': Rename_Task, 'duration_secs': 0.154716} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  769.161010] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  769.161934] env[65478]: DEBUG oslo_vmware.service [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-5a53fa60-a518-43bd-a962-ab30ba791581 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  769.167423] env[65478]: DEBUG oslo_vmware.api [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Waiting for the task: (returnval){
[  769.167423] env[65478]:    value = "task-6011589"
[  769.167423] env[65478]:    _type = "Task"
[  769.167423] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  769.177131] env[65478]: DEBUG oslo_vmware.api [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Task: {'id': task-6011589, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  769.186852] env[65478]: DEBUG oslo_vmware.service [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f9a497f5-60ab-4b81-8c2e-c7a8002d41e5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  769.193075] env[65478]: DEBUG oslo_vmware.service [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-21918f27-7125-429d-bb2e-d9867cb28650 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  769.214815] env[65478]: DEBUG oslo_vmware.api [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011587, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.545175} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  769.220559] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Copied Virtual Disk [datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore2] 788343e6-5c24-4e9b-9c74-e14f3b179cdb/788343e6-5c24-4e9b-9c74-e14f3b179cdb.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  769.220753] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  769.221454] env[65478]: DEBUG oslo_vmware.service [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-889d766c-2aa5-447e-b6de-60cbbddd4f2b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  769.236529] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Releasing lock "refresh_cache-4821048b-4b5a-40b5-8888-f00dd28425d1" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  769.236529] env[65478]: DEBUG nova.compute.manager [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Instance network_info: |[{"id": "e599424e-fe74-4d2c-948c-3759b6289f44", "address": "fa:16:3e:c1:84:26", "network": {"id": "386793de-d2e2-4c26-8cab-60dbf2a2ffe3", "bridge": "br-int", "label": "tempest-InstanceActionsTestJSON-2039284656-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60c31211e0004fe78fab62e554754271", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "50886eea-591a-452c-a27b-5f22cfc9df85", "external-id": "nsx-vlan-transportzone-578", "segmentation_id": 578, "bound_drivers": {"0": "nsxv3"}}, "devname": "tape599424e-fe", "ovs_interfaceid": "e599424e-fe74-4d2c-948c-3759b6289f44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  769.237050] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:c1:84:26', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': '50886eea-591a-452c-a27b-5f22cfc9df85', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': 'e599424e-fe74-4d2c-948c-3759b6289f44', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  769.258884] env[65478]: DEBUG oslo_vmware.api [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Waiting for the task: (returnval){
[  769.258884] env[65478]:    value = "task-6011590"
[  769.258884] env[65478]:    _type = "Task"
[  769.258884] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  769.284889] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Creating folder: Project (60c31211e0004fe78fab62e554754271). Parent ref: group-v1161186. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  769.285740] env[65478]: DEBUG oslo_vmware.service [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8588194f-fa4a-4327-b98c-9e9e730f1a45 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  769.292738] env[65478]: DEBUG oslo_vmware.service [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-a4741c65-d0a3-4246-8af5-6120a154e2d9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  769.298233] env[65478]: DEBUG oslo_vmware.api [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52eee525-371e-9ae6-d2be-12c4f813744a, 'name': SearchDatastore_Task, 'duration_secs': 0.01051} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  769.300334] env[65478]: DEBUG oslo_vmware.api [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011590, 'name': ExtendVirtualDisk_Task} progress is 50%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  769.311272] env[65478]: DEBUG oslo_vmware.service [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-b807d388-d27d-45d1-a149-2c02aa06762c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  769.315316] env[65478]: DEBUG oslo_vmware.service [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8d38397a-8746-48cb-8098-1f997f443282 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  769.321660] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Created folder: Project (60c31211e0004fe78fab62e554754271) in parent group-v1161186.
[  769.322668] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Creating folder: Instances. Parent ref: group-v1161238. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  769.322668] env[65478]: DEBUG oslo_vmware.service [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-51c425ad-25b3-4538-8e46-c655c5043a10 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  769.332090] env[65478]: DEBUG oslo_vmware.api [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Waiting for the task: (returnval){
[  769.332090] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]5220240b-7af7-6291-7c1e-5ddb3a5dea10"
[  769.332090] env[65478]:    _type = "Task"
[  769.332090] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  769.336487] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Created folder: Instances in parent group-v1161238.
[  769.345017] env[65478]: DEBUG nova.compute.provider_tree [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  769.347176] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  769.347460] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  769.348101] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-30fe475c-bfcb-45e1-958d-e1ec550b2445 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  769.359325] env[65478]: DEBUG oslo_vmware.api [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5220240b-7af7-6291-7c1e-5ddb3a5dea10, 'name': SearchDatastore_Task, 'duration_secs': 0.010293} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  769.365200] env[65478]: DEBUG oslo_concurrency.lockutils [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Releasing lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  769.366122] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Copying Virtual Disk [datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore2] f01c577a-3995-465a-98ae-21880df54cc0/f01c577a-3995-465a-98ae-21880df54cc0.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  769.367480] env[65478]: DEBUG oslo_vmware.service [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-7b193d4c-c5c0-4709-97b9-28936af2c4a6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  769.388987] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  769.388987] env[65478]:    value = "task-6011593"
[  769.388987] env[65478]:    _type = "Task"
[  769.388987] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  769.398045] env[65478]: DEBUG oslo_vmware.api [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Waiting for the task: (returnval){
[  769.398045] env[65478]:    value = "task-6011594"
[  769.398045] env[65478]:    _type = "Task"
[  769.398045] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  769.407096] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011593, 'name': CreateVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  769.409371] env[65478]: DEBUG oslo_concurrency.lockutils [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Acquiring lock "4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  769.409964] env[65478]: DEBUG oslo_concurrency.lockutils [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Lock "4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  769.416386] env[65478]: DEBUG oslo_vmware.api [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Task: {'id': task-6011594, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  769.503082] env[65478]: WARNING neutronclient.v2_0.client [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  769.685938] env[65478]: DEBUG oslo_vmware.api [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Task: {'id': task-6011589, 'name': PowerOnVM_Task} progress is 89%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  769.793620] env[65478]: DEBUG oslo_vmware.api [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011590, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.066272} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  769.794129] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  769.795332] env[65478]: DEBUG oslo_vmware.service [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b867a5a3-02e9-4d9c-b4d9-9a4393405778 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  769.830899] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Reconfiguring VM instance instance-00000011 to attach disk [datastore2] 788343e6-5c24-4e9b-9c74-e14f3b179cdb/788343e6-5c24-4e9b-9c74-e14f3b179cdb.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  769.836030] env[65478]: DEBUG oslo_vmware.service [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-8c024577-0465-4148-b858-99777f4f5fea {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  769.856942] env[65478]: DEBUG nova.scheduler.client.report [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  769.868496] env[65478]: DEBUG oslo_vmware.api [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Waiting for the task: (returnval){
[  769.868496] env[65478]:    value = "task-6011595"
[  769.868496] env[65478]:    _type = "Task"
[  769.868496] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  769.882655] env[65478]: DEBUG oslo_vmware.api [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011595, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  769.901726] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011593, 'name': CreateVM_Task, 'duration_secs': 0.468045} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  769.906931] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  769.907490] env[65478]: WARNING neutronclient.v2_0.client [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  769.908173] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Acquiring lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  769.908349] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Acquired lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  769.908698] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Acquired external semaphore "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  769.909410] env[65478]: DEBUG oslo_vmware.service [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-8fcfea3f-ce10-4bc0-961d-71ca73814ad7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  769.916569] env[65478]: DEBUG oslo_vmware.api [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Waiting for the task: (returnval){
[  769.916569] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]5263f495-ad3b-b3e9-1523-8813a5d16d3c"
[  769.916569] env[65478]:    _type = "Task"
[  769.916569] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  769.925706] env[65478]: DEBUG oslo_vmware.api [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Task: {'id': task-6011594, 'name': CopyVirtualDisk_Task} progress is 77%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  769.928266] env[65478]: DEBUG nova.compute.manager [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  769.936529] env[65478]: DEBUG oslo_vmware.api [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5263f495-ad3b-b3e9-1523-8813a5d16d3c, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  770.111132] env[65478]: DEBUG nova.compute.manager [req-dffedb3c-e951-46fe-b087-6e0b5e969f9d req-fe74e6f7-6250-4c29-9842-96a6ffba719b service nova] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Received event network-changed-320b5203-7ff1-4f52-a15b-995d50391e39 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  770.111540] env[65478]: DEBUG nova.compute.manager [req-dffedb3c-e951-46fe-b087-6e0b5e969f9d req-fe74e6f7-6250-4c29-9842-96a6ffba719b service nova] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Refreshing instance network info cache due to event network-changed-320b5203-7ff1-4f52-a15b-995d50391e39. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  770.112077] env[65478]: DEBUG oslo_concurrency.lockutils [req-dffedb3c-e951-46fe-b087-6e0b5e969f9d req-fe74e6f7-6250-4c29-9842-96a6ffba719b service nova] Acquiring lock "refresh_cache-98b2d40a-0c59-4540-b60e-17e5206dea42" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  770.112312] env[65478]: DEBUG oslo_concurrency.lockutils [req-dffedb3c-e951-46fe-b087-6e0b5e969f9d req-fe74e6f7-6250-4c29-9842-96a6ffba719b service nova] Acquired lock "refresh_cache-98b2d40a-0c59-4540-b60e-17e5206dea42" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  770.112547] env[65478]: DEBUG nova.network.neutron [req-dffedb3c-e951-46fe-b087-6e0b5e969f9d req-fe74e6f7-6250-4c29-9842-96a6ffba719b service nova] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Refreshing network info cache for port 320b5203-7ff1-4f52-a15b-995d50391e39 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  770.183234] env[65478]: DEBUG oslo_vmware.api [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Task: {'id': task-6011589, 'name': PowerOnVM_Task, 'duration_secs': 0.599186} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  770.183234] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  770.183234] env[65478]: INFO nova.compute.manager [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Took 15.47 seconds to spawn the instance on the hypervisor.
[  770.183234] env[65478]: DEBUG nova.compute.manager [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  770.183675] env[65478]: DEBUG oslo_vmware.service [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-41d89a3a-209e-4076-a3e0-cdfba6bc28a4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  770.370608] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.535s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  770.378067] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.860s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  770.380033] env[65478]: DEBUG nova.compute.manager [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  770.384363] env[65478]: INFO nova.compute.claims [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  770.393915] env[65478]: DEBUG oslo_vmware.api [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011595, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  770.414112] env[65478]: DEBUG oslo_vmware.api [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Task: {'id': task-6011594, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.568305} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  770.414112] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Copied Virtual Disk [datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore2] f01c577a-3995-465a-98ae-21880df54cc0/f01c577a-3995-465a-98ae-21880df54cc0.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  770.414112] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  770.414112] env[65478]: DEBUG oslo_vmware.service [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-cc2b2485-4e6c-4523-ba7d-dcff4377e713 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  770.420708] env[65478]: DEBUG oslo_vmware.api [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Waiting for the task: (returnval){
[  770.420708] env[65478]:    value = "task-6011596"
[  770.420708] env[65478]:    _type = "Task"
[  770.420708] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  770.440231] env[65478]: DEBUG oslo_vmware.api [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Task: {'id': task-6011596, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  770.443438] env[65478]: DEBUG oslo_vmware.api [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5263f495-ad3b-b3e9-1523-8813a5d16d3c, 'name': SearchDatastore_Task, 'duration_secs': 0.024747} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  770.445094] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Releasing lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  770.446969] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  770.450508] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Acquiring lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  770.450508] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Acquired lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  770.450508] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Creating directory with path [datastore2] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  770.451452] env[65478]: DEBUG oslo_vmware.service [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-b4e24315-4c7a-45ce-8c51-399a722d9d1f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  770.462419] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Created directory with path [datastore2] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  770.464925] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Folder [datastore2] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  770.465976] env[65478]: DEBUG oslo_vmware.service [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-5ea2c2f1-49c2-4fdc-baa3-ddaa9f386b4d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  770.479356] env[65478]: DEBUG oslo_vmware.api [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Waiting for the task: (returnval){
[  770.479356] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52578839-94c5-10c5-ef66-ed87c8346da1"
[  770.479356] env[65478]:    _type = "Task"
[  770.479356] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  770.483049] env[65478]: DEBUG oslo_concurrency.lockutils [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  770.491236] env[65478]: DEBUG oslo_vmware.api [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52578839-94c5-10c5-ef66-ed87c8346da1, 'name': SearchDatastore_Task, 'duration_secs': 0.009654} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  770.492778] env[65478]: DEBUG oslo_vmware.service [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-f40b91eb-c854-4085-b200-d61548abb924 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  770.498687] env[65478]: DEBUG oslo_vmware.api [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Waiting for the task: (returnval){
[  770.498687] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]5224030c-4f29-f762-f1f0-65ccd4733238"
[  770.498687] env[65478]:    _type = "Task"
[  770.498687] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  770.507281] env[65478]: DEBUG oslo_vmware.api [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5224030c-4f29-f762-f1f0-65ccd4733238, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  770.618341] env[65478]: WARNING neutronclient.v2_0.client [req-dffedb3c-e951-46fe-b087-6e0b5e969f9d req-fe74e6f7-6250-4c29-9842-96a6ffba719b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  770.707903] env[65478]: INFO nova.compute.manager [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Took 20.44 seconds to build instance.
[  770.883641] env[65478]: DEBUG oslo_vmware.api [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011595, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  770.897703] env[65478]: DEBUG nova.compute.utils [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  770.900115] env[65478]: DEBUG nova.compute.manager [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  770.900292] env[65478]: DEBUG nova.network.neutron [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  770.900833] env[65478]: WARNING neutronclient.v2_0.client [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  770.901524] env[65478]: WARNING neutronclient.v2_0.client [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  770.930442] env[65478]: DEBUG oslo_vmware.api [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Task: {'id': task-6011596, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.073756} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  770.930664] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  770.931540] env[65478]: DEBUG oslo_vmware.service [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-fc3f65e9-6d5d-40a2-9eec-989bb1983589 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  770.958274] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Reconfiguring VM instance instance-00000012 to attach disk [datastore2] f01c577a-3995-465a-98ae-21880df54cc0/f01c577a-3995-465a-98ae-21880df54cc0.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  770.958687] env[65478]: DEBUG oslo_vmware.service [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-122498ff-b123-4a86-97aa-e9e8da584e4b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  770.987752] env[65478]: DEBUG oslo_vmware.api [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Waiting for the task: (returnval){
[  770.987752] env[65478]:    value = "task-6011597"
[  770.987752] env[65478]:    _type = "Task"
[  770.987752] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  771.000260] env[65478]: DEBUG oslo_vmware.api [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Task: {'id': task-6011597, 'name': ReconfigVM_Task} progress is 10%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  771.009919] env[65478]: DEBUG oslo_vmware.api [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5224030c-4f29-f762-f1f0-65ccd4733238, 'name': SearchDatastore_Task, 'duration_secs': 0.008999} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  771.010201] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Releasing lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  771.010427] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Copying Virtual Disk [datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore2] 4821048b-4b5a-40b5-8888-f00dd28425d1/4821048b-4b5a-40b5-8888-f00dd28425d1.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  771.010866] env[65478]: DEBUG oslo_vmware.service [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-8fec0a03-902a-4143-b881-e06f985215d9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  771.016568] env[65478]: DEBUG oslo_vmware.api [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Waiting for the task: (returnval){
[  771.016568] env[65478]:    value = "task-6011598"
[  771.016568] env[65478]:    _type = "Task"
[  771.016568] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  771.026007] env[65478]: DEBUG oslo_vmware.api [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Task: {'id': task-6011598, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  771.030488] env[65478]: WARNING neutronclient.v2_0.client [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  771.115596] env[65478]: DEBUG nova.policy [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61014c2805204c7fbef39184f26a01b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f872aa3128c4866aed16d152b15486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  771.209541] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e403efec-1c9f-46d1-a2eb-68b19b871bfa tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Lock "eb076624-c76c-47da-9320-5fc13a51b365" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.958s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  771.367751] env[65478]: DEBUG nova.network.neutron [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Updated VIF entry in instance network info cache for port fe1047e6-be6d-4718-a53e-e21e2b96dcc9. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  771.367751] env[65478]: DEBUG nova.network.neutron [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Updating instance_info_cache with network_info: [{"id": "fe1047e6-be6d-4718-a53e-e21e2b96dcc9", "address": "fa:16:3e:d1:4a:a6", "network": {"id": "7f931794-a55e-4262-acec-b60daf9cf019", "bridge": "br-int", "label": "tempest-ServersTestManualDisk-1906004701-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "4d4c6f3c8d4a40f68deffc1fd31d86ba", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "6b151a0c-aa46-4d21-9ef5-c09cf350b19c", "external-id": "nsx-vlan-transportzone-343", "segmentation_id": 343, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapfe1047e6-be", "ovs_interfaceid": "fe1047e6-be6d-4718-a53e-e21e2b96dcc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  771.385145] env[65478]: DEBUG oslo_vmware.api [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011595, 'name': ReconfigVM_Task, 'duration_secs': 1.228719} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  771.385645] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Reconfigured VM instance instance-00000011 to attach disk [datastore2] 788343e6-5c24-4e9b-9c74-e14f3b179cdb/788343e6-5c24-4e9b-9c74-e14f3b179cdb.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  771.386195] env[65478]: DEBUG oslo_vmware.service [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-95eba837-068f-4c03-a15a-1bf300f1ae39 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  771.393124] env[65478]: DEBUG oslo_vmware.api [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Waiting for the task: (returnval){
[  771.393124] env[65478]:    value = "task-6011599"
[  771.393124] env[65478]:    _type = "Task"
[  771.393124] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  771.404397] env[65478]: DEBUG oslo_vmware.api [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011599, 'name': Rename_Task} progress is 5%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  771.407369] env[65478]: DEBUG nova.compute.manager [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  771.512092] env[65478]: DEBUG oslo_vmware.api [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Task: {'id': task-6011597, 'name': ReconfigVM_Task, 'duration_secs': 0.38719} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  771.512480] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Reconfigured VM instance instance-00000012 to attach disk [datastore2] f01c577a-3995-465a-98ae-21880df54cc0/f01c577a-3995-465a-98ae-21880df54cc0.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  771.516376] env[65478]: DEBUG oslo_vmware.service [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-9623cc75-c8e8-4ca6-af68-5cb69aa7db41 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  771.530243] env[65478]: DEBUG oslo_vmware.api [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Waiting for the task: (returnval){
[  771.530243] env[65478]:    value = "task-6011600"
[  771.530243] env[65478]:    _type = "Task"
[  771.530243] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  771.548459] env[65478]: DEBUG oslo_vmware.api [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Task: {'id': task-6011598, 'name': CopyVirtualDisk_Task} progress is 77%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  771.557972] env[65478]: DEBUG oslo_vmware.api [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Task: {'id': task-6011600, 'name': Rename_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  771.783733] env[65478]: DEBUG oslo_vmware.service [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1c2c8de0-4627-4bbb-9a6a-1d6860fd78b5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  771.792943] env[65478]: DEBUG oslo_vmware.service [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-30b3e28e-cdb4-4b3d-ab62-32e6bde3455f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  771.800852] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Acquiring lock "6ef7bbde-0ba8-44a9-8643-e674a14f3cbc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  771.802219] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Lock "6ef7bbde-0ba8-44a9-8643-e674a14f3cbc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  771.805469] env[65478]: DEBUG nova.network.neutron [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Successfully created port: a4636485-7b6f-4fbb-ab94-d4f75ada7a1c {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  771.839668] env[65478]: DEBUG oslo_vmware.service [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-621e883f-118d-474d-a7a3-ab9a340bfece {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  771.843185] env[65478]: WARNING neutronclient.v2_0.client [req-dffedb3c-e951-46fe-b087-6e0b5e969f9d req-fe74e6f7-6250-4c29-9842-96a6ffba719b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  771.853137] env[65478]: DEBUG oslo_vmware.service [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-fb559016-5609-4c72-8850-9df894638edb {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  771.873799] env[65478]: DEBUG nova.compute.provider_tree [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  771.876085] env[65478]: DEBUG oslo_concurrency.lockutils [req-12d1abd8-877c-4588-9840-37a4a424b70b req-6ee4bcf4-303e-4705-895b-7a1510f10795 service nova] Releasing lock "refresh_cache-eb466e5e-a499-4856-9c12-c7ca87b53230" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  771.910510] env[65478]: DEBUG oslo_vmware.api [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011599, 'name': Rename_Task, 'duration_secs': 0.18028} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  771.911145] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  771.911582] env[65478]: DEBUG oslo_vmware.service [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-43270780-5af1-4941-bad5-01cabd467a22 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  771.924045] env[65478]: DEBUG oslo_vmware.api [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Waiting for the task: (returnval){
[  771.924045] env[65478]:    value = "task-6011601"
[  771.924045] env[65478]:    _type = "Task"
[  771.924045] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  771.930643] env[65478]: DEBUG oslo_vmware.api [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011601, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  772.034294] env[65478]: DEBUG oslo_vmware.api [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Task: {'id': task-6011598, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.550049} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  772.034508] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Copied Virtual Disk [datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore2] 4821048b-4b5a-40b5-8888-f00dd28425d1/4821048b-4b5a-40b5-8888-f00dd28425d1.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  772.034741] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  772.034927] env[65478]: DEBUG oslo_vmware.service [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-ddc158d1-2d6b-4f25-84f2-8f7dbfc4a356 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  772.044355] env[65478]: DEBUG oslo_vmware.api [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Waiting for the task: (returnval){
[  772.044355] env[65478]:    value = "task-6011602"
[  772.044355] env[65478]:    _type = "Task"
[  772.044355] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  772.069582] env[65478]: DEBUG oslo_vmware.api [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Task: {'id': task-6011600, 'name': Rename_Task, 'duration_secs': 0.149946} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  772.069582] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  772.069582] env[65478]: DEBUG oslo_vmware.service [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-c82d048c-65b9-456a-95c8-ee7f65d0f454 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  772.076062] env[65478]: DEBUG oslo_vmware.api [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Task: {'id': task-6011602, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  772.084995] env[65478]: DEBUG oslo_vmware.api [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Waiting for the task: (returnval){
[  772.084995] env[65478]:    value = "task-6011603"
[  772.084995] env[65478]:    _type = "Task"
[  772.084995] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  772.103020] env[65478]: DEBUG oslo_vmware.api [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Task: {'id': task-6011603, 'name': PowerOnVM_Task} progress is 33%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  772.231694] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Acquiring lock "b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  772.233474] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Lock "b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  772.355170] env[65478]: DEBUG nova.compute.manager [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  772.370045] env[65478]: DEBUG nova.network.neutron [req-dffedb3c-e951-46fe-b087-6e0b5e969f9d req-fe74e6f7-6250-4c29-9842-96a6ffba719b service nova] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Updated VIF entry in instance network info cache for port 320b5203-7ff1-4f52-a15b-995d50391e39. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  772.371039] env[65478]: DEBUG nova.network.neutron [req-dffedb3c-e951-46fe-b087-6e0b5e969f9d req-fe74e6f7-6250-4c29-9842-96a6ffba719b service nova] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Updating instance_info_cache with network_info: [{"id": "320b5203-7ff1-4f52-a15b-995d50391e39", "address": "fa:16:3e:c7:10:4c", "network": {"id": "4a1b5d4b-4c82-4116-be7c-20e7f0f647cd", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1744686632-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "10.180.180.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "183f1111bd4a4c13a354835aa7266cc2", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "c2d3bf80-d60a-4b53-a00a-1381de6d4a12", "external-id": "nsx-vlan-transportzone-982", "segmentation_id": 982, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap320b5203-7f", "ovs_interfaceid": "320b5203-7ff1-4f52-a15b-995d50391e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  772.384538] env[65478]: DEBUG nova.scheduler.client.report [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  772.420568] env[65478]: DEBUG nova.compute.manager [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  772.436262] env[65478]: DEBUG oslo_vmware.api [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011601, 'name': PowerOnVM_Task} progress is 1%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  772.457638] env[65478]: DEBUG nova.virt.hardware [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  772.457968] env[65478]: DEBUG nova.virt.hardware [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  772.457968] env[65478]: DEBUG nova.virt.hardware [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  772.458141] env[65478]: DEBUG nova.virt.hardware [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  772.458246] env[65478]: DEBUG nova.virt.hardware [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  772.458352] env[65478]: DEBUG nova.virt.hardware [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  772.458535] env[65478]: DEBUG nova.virt.hardware [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  772.458665] env[65478]: DEBUG nova.virt.hardware [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  772.458781] env[65478]: DEBUG nova.virt.hardware [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  772.458918] env[65478]: DEBUG nova.virt.hardware [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  772.459192] env[65478]: DEBUG nova.virt.hardware [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  772.460384] env[65478]: DEBUG oslo_vmware.service [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c4d26c46-6761-4762-a425-34da32a236a8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  772.468777] env[65478]: DEBUG oslo_vmware.service [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-00c0cdb9-b782-497e-9717-d07a22850f35 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  772.552919] env[65478]: DEBUG oslo_vmware.api [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Task: {'id': task-6011602, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.06679} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  772.553155] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  772.554037] env[65478]: DEBUG oslo_vmware.service [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-39ff103a-8049-4c7e-92dd-2b8c49d13ac5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  772.586429] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Reconfiguring VM instance instance-00000013 to attach disk [datastore2] 4821048b-4b5a-40b5-8888-f00dd28425d1/4821048b-4b5a-40b5-8888-f00dd28425d1.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  772.597321] env[65478]: DEBUG oslo_vmware.service [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-3754eb41-fc80-4b7a-a17d-5b60132daa6d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  772.608034] env[65478]: DEBUG oslo_vmware.api [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Task: {'id': task-6011603, 'name': PowerOnVM_Task} progress is 88%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  772.629212] env[65478]: DEBUG oslo_vmware.api [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Waiting for the task: (returnval){
[  772.629212] env[65478]:    value = "task-6011604"
[  772.629212] env[65478]:    _type = "Task"
[  772.629212] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  772.639628] env[65478]: DEBUG oslo_vmware.api [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Task: {'id': task-6011604, 'name': ReconfigVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  772.736068] env[65478]: DEBUG nova.compute.manager [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  772.852430] env[65478]: INFO nova.compute.manager [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] [instance: 95525483-b7db-427e-87b5-3f946972a250] Rebuilding instance
[  772.873986] env[65478]: DEBUG oslo_concurrency.lockutils [req-dffedb3c-e951-46fe-b087-6e0b5e969f9d req-fe74e6f7-6250-4c29-9842-96a6ffba719b service nova] Releasing lock "refresh_cache-98b2d40a-0c59-4540-b60e-17e5206dea42" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  772.874353] env[65478]: DEBUG nova.compute.manager [req-dffedb3c-e951-46fe-b087-6e0b5e969f9d req-fe74e6f7-6250-4c29-9842-96a6ffba719b service nova] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Received event network-vif-plugged-5c9a8578-bb94-4d72-acef-25b60278df21 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  772.874609] env[65478]: DEBUG oslo_concurrency.lockutils [req-dffedb3c-e951-46fe-b087-6e0b5e969f9d req-fe74e6f7-6250-4c29-9842-96a6ffba719b service nova] Acquiring lock "eb076624-c76c-47da-9320-5fc13a51b365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  772.874798] env[65478]: DEBUG oslo_concurrency.lockutils [req-dffedb3c-e951-46fe-b087-6e0b5e969f9d req-fe74e6f7-6250-4c29-9842-96a6ffba719b service nova] Lock "eb076624-c76c-47da-9320-5fc13a51b365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  772.875362] env[65478]: DEBUG oslo_concurrency.lockutils [req-dffedb3c-e951-46fe-b087-6e0b5e969f9d req-fe74e6f7-6250-4c29-9842-96a6ffba719b service nova] Lock "eb076624-c76c-47da-9320-5fc13a51b365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  772.875523] env[65478]: DEBUG nova.compute.manager [req-dffedb3c-e951-46fe-b087-6e0b5e969f9d req-fe74e6f7-6250-4c29-9842-96a6ffba719b service nova] [instance: eb076624-c76c-47da-9320-5fc13a51b365] No waiting events found dispatching network-vif-plugged-5c9a8578-bb94-4d72-acef-25b60278df21 {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  772.875621] env[65478]: WARNING nova.compute.manager [req-dffedb3c-e951-46fe-b087-6e0b5e969f9d req-fe74e6f7-6250-4c29-9842-96a6ffba719b service nova] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Received unexpected event network-vif-plugged-5c9a8578-bb94-4d72-acef-25b60278df21 for instance with vm_state building and task_state spawning.
[  772.877058] env[65478]: DEBUG nova.compute.manager [req-dffedb3c-e951-46fe-b087-6e0b5e969f9d req-fe74e6f7-6250-4c29-9842-96a6ffba719b service nova] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Received event network-changed-5c9a8578-bb94-4d72-acef-25b60278df21 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  772.877058] env[65478]: DEBUG nova.compute.manager [req-dffedb3c-e951-46fe-b087-6e0b5e969f9d req-fe74e6f7-6250-4c29-9842-96a6ffba719b service nova] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Refreshing instance network info cache due to event network-changed-5c9a8578-bb94-4d72-acef-25b60278df21. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  772.877058] env[65478]: DEBUG oslo_concurrency.lockutils [req-dffedb3c-e951-46fe-b087-6e0b5e969f9d req-fe74e6f7-6250-4c29-9842-96a6ffba719b service nova] Acquiring lock "refresh_cache-eb076624-c76c-47da-9320-5fc13a51b365" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  772.877058] env[65478]: DEBUG oslo_concurrency.lockutils [req-dffedb3c-e951-46fe-b087-6e0b5e969f9d req-fe74e6f7-6250-4c29-9842-96a6ffba719b service nova] Acquired lock "refresh_cache-eb076624-c76c-47da-9320-5fc13a51b365" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  772.877058] env[65478]: DEBUG nova.network.neutron [req-dffedb3c-e951-46fe-b087-6e0b5e969f9d req-fe74e6f7-6250-4c29-9842-96a6ffba719b service nova] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Refreshing network info cache for port 5c9a8578-bb94-4d72-acef-25b60278df21 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  772.890893] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.512s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  772.891867] env[65478]: DEBUG nova.compute.manager [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  772.895138] env[65478]: DEBUG oslo_concurrency.lockutils [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.411s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  772.901687] env[65478]: INFO nova.compute.claims [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  772.914188] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  772.942040] env[65478]: DEBUG oslo_vmware.api [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011601, 'name': PowerOnVM_Task} progress is 82%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  772.945702] env[65478]: DEBUG nova.compute.manager [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] [instance: 95525483-b7db-427e-87b5-3f946972a250] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  772.947232] env[65478]: DEBUG oslo_vmware.service [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e864a03c-0fa3-4a95-aef8-f91d1c2cb0d5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  773.096128] env[65478]: DEBUG oslo_vmware.api [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Task: {'id': task-6011603, 'name': PowerOnVM_Task, 'duration_secs': 0.598202} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  773.096361] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  773.096524] env[65478]: INFO nova.compute.manager [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Took 12.09 seconds to spawn the instance on the hypervisor.
[  773.096744] env[65478]: DEBUG nova.compute.manager [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  773.097594] env[65478]: DEBUG oslo_vmware.service [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-7e62cf9b-baa5-4ce2-a88a-92d7ce74c054 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  773.142704] env[65478]: DEBUG oslo_vmware.api [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Task: {'id': task-6011604, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  773.239261] env[65478]: DEBUG nova.compute.manager [req-f9a18ee5-cf7d-4aa4-b03b-cb75cd334ba5 req-4a8a30f2-4eeb-4358-acd9-4307ed9101df service nova] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Received event network-vif-plugged-c753d998-c733-4ef7-b4fc-008c7024f5ef {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  773.240152] env[65478]: DEBUG oslo_concurrency.lockutils [req-f9a18ee5-cf7d-4aa4-b03b-cb75cd334ba5 req-4a8a30f2-4eeb-4358-acd9-4307ed9101df service nova] Acquiring lock "788343e6-5c24-4e9b-9c74-e14f3b179cdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  773.240152] env[65478]: DEBUG oslo_concurrency.lockutils [req-f9a18ee5-cf7d-4aa4-b03b-cb75cd334ba5 req-4a8a30f2-4eeb-4358-acd9-4307ed9101df service nova] Lock "788343e6-5c24-4e9b-9c74-e14f3b179cdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  773.240152] env[65478]: DEBUG oslo_concurrency.lockutils [req-f9a18ee5-cf7d-4aa4-b03b-cb75cd334ba5 req-4a8a30f2-4eeb-4358-acd9-4307ed9101df service nova] Lock "788343e6-5c24-4e9b-9c74-e14f3b179cdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  773.240615] env[65478]: DEBUG nova.compute.manager [req-f9a18ee5-cf7d-4aa4-b03b-cb75cd334ba5 req-4a8a30f2-4eeb-4358-acd9-4307ed9101df service nova] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] No waiting events found dispatching network-vif-plugged-c753d998-c733-4ef7-b4fc-008c7024f5ef {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  773.241678] env[65478]: WARNING nova.compute.manager [req-f9a18ee5-cf7d-4aa4-b03b-cb75cd334ba5 req-4a8a30f2-4eeb-4358-acd9-4307ed9101df service nova] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Received unexpected event network-vif-plugged-c753d998-c733-4ef7-b4fc-008c7024f5ef for instance with vm_state building and task_state spawning.
[  773.242798] env[65478]: DEBUG nova.compute.manager [req-f9a18ee5-cf7d-4aa4-b03b-cb75cd334ba5 req-4a8a30f2-4eeb-4358-acd9-4307ed9101df service nova] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Received event network-changed-c753d998-c733-4ef7-b4fc-008c7024f5ef {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  773.243206] env[65478]: DEBUG nova.compute.manager [req-f9a18ee5-cf7d-4aa4-b03b-cb75cd334ba5 req-4a8a30f2-4eeb-4358-acd9-4307ed9101df service nova] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Refreshing instance network info cache due to event network-changed-c753d998-c733-4ef7-b4fc-008c7024f5ef. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  773.243506] env[65478]: DEBUG oslo_concurrency.lockutils [req-f9a18ee5-cf7d-4aa4-b03b-cb75cd334ba5 req-4a8a30f2-4eeb-4358-acd9-4307ed9101df service nova] Acquiring lock "refresh_cache-788343e6-5c24-4e9b-9c74-e14f3b179cdb" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  773.243559] env[65478]: DEBUG oslo_concurrency.lockutils [req-f9a18ee5-cf7d-4aa4-b03b-cb75cd334ba5 req-4a8a30f2-4eeb-4358-acd9-4307ed9101df service nova] Acquired lock "refresh_cache-788343e6-5c24-4e9b-9c74-e14f3b179cdb" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  773.243859] env[65478]: DEBUG nova.network.neutron [req-f9a18ee5-cf7d-4aa4-b03b-cb75cd334ba5 req-4a8a30f2-4eeb-4358-acd9-4307ed9101df service nova] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Refreshing network info cache for port c753d998-c733-4ef7-b4fc-008c7024f5ef {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  773.266012] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  773.383612] env[65478]: WARNING neutronclient.v2_0.client [req-dffedb3c-e951-46fe-b087-6e0b5e969f9d req-fe74e6f7-6250-4c29-9842-96a6ffba719b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  773.403951] env[65478]: DEBUG nova.compute.utils [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  773.405232] env[65478]: DEBUG nova.compute.manager [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  773.405540] env[65478]: DEBUG nova.network.neutron [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  773.406188] env[65478]: WARNING neutronclient.v2_0.client [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  773.406188] env[65478]: WARNING neutronclient.v2_0.client [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  773.437509] env[65478]: DEBUG oslo_vmware.api [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011601, 'name': PowerOnVM_Task, 'duration_secs': 1.067937} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  773.437689] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  773.437849] env[65478]: INFO nova.compute.manager [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Took 16.25 seconds to spawn the instance on the hypervisor.
[  773.437987] env[65478]: DEBUG nova.compute.manager [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  773.438939] env[65478]: DEBUG oslo_vmware.service [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4430d9f1-6128-4696-9d4f-947860926c7a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  773.591316] env[65478]: DEBUG nova.network.neutron [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Successfully updated port: a4636485-7b6f-4fbb-ab94-d4f75ada7a1c {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  773.619836] env[65478]: INFO nova.compute.manager [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Took 17.05 seconds to build instance.
[  773.641753] env[65478]: DEBUG oslo_vmware.api [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Task: {'id': task-6011604, 'name': ReconfigVM_Task, 'duration_secs': 0.569562} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  773.642205] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Reconfigured VM instance instance-00000013 to attach disk [datastore2] 4821048b-4b5a-40b5-8888-f00dd28425d1/4821048b-4b5a-40b5-8888-f00dd28425d1.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  773.643614] env[65478]: DEBUG oslo_vmware.service [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-91b0c288-5e04-41a0-acfe-98b44a847fa0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  773.648276] env[65478]: DEBUG oslo_vmware.api [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Waiting for the task: (returnval){
[  773.648276] env[65478]:    value = "task-6011605"
[  773.648276] env[65478]:    _type = "Task"
[  773.648276] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  773.656728] env[65478]: DEBUG oslo_vmware.api [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Task: {'id': task-6011605, 'name': Rename_Task} progress is 5%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  773.666737] env[65478]: DEBUG nova.policy [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e90fae5080e0457a9557b6974756034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a09b6e5ab3418e871f2d26fcd10a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  773.696129] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Acquiring lock "6a23cbd2-7031-484c-809e-436397029c7d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  773.697411] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Lock "6a23cbd2-7031-484c-809e-436397029c7d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  773.697411] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Acquiring lock "6a23cbd2-7031-484c-809e-436397029c7d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  773.697411] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Lock "6a23cbd2-7031-484c-809e-436397029c7d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  773.697411] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Lock "6a23cbd2-7031-484c-809e-436397029c7d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  773.698986] env[65478]: INFO nova.compute.manager [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Terminating instance
[  773.748346] env[65478]: WARNING neutronclient.v2_0.client [req-f9a18ee5-cf7d-4aa4-b03b-cb75cd334ba5 req-4a8a30f2-4eeb-4358-acd9-4307ed9101df service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  773.909807] env[65478]: DEBUG nova.compute.manager [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  773.961684] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] [instance: 95525483-b7db-427e-87b5-3f946972a250] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  773.962146] env[65478]: DEBUG oslo_vmware.service [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-c6efc130-3fe1-4639-9ef5-3a67aa99a2f6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  773.963437] env[65478]: INFO nova.compute.manager [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Took 21.82 seconds to build instance.
[  773.969066] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Waiting for the task: (returnval){
[  773.969066] env[65478]:    value = "task-6011606"
[  773.969066] env[65478]:    _type = "Task"
[  773.969066] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  773.978189] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Task: {'id': task-6011606, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  774.095240] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Acquiring lock "refresh_cache-d978e71d-2c30-4a76-b000-6ddf3203ab10" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  774.095391] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Acquired lock "refresh_cache-d978e71d-2c30-4a76-b000-6ddf3203ab10" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  774.096219] env[65478]: DEBUG nova.network.neutron [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  774.121538] env[65478]: DEBUG oslo_concurrency.lockutils [None req-842f71cb-d8fb-4e05-97a6-651eabdc606e tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Lock "f01c577a-3995-465a-98ae-21880df54cc0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.572s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  774.146731] env[65478]: DEBUG nova.network.neutron [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Successfully created port: 321b5f6a-6eb5-4a41-86a9-3eac3f4def7b {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  774.165821] env[65478]: DEBUG oslo_vmware.api [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Task: {'id': task-6011605, 'name': Rename_Task, 'duration_secs': 0.363996} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  774.165821] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  774.165821] env[65478]: DEBUG oslo_vmware.service [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-70760bc2-f1d1-4c73-9666-2db81a35f0ba {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  774.175842] env[65478]: DEBUG oslo_vmware.api [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Waiting for the task: (returnval){
[  774.175842] env[65478]:    value = "task-6011607"
[  774.175842] env[65478]:    _type = "Task"
[  774.175842] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  774.184806] env[65478]: DEBUG oslo_vmware.api [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Task: {'id': task-6011607, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  774.203230] env[65478]: DEBUG nova.compute.manager [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[  774.203420] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  774.204836] env[65478]: DEBUG oslo_vmware.service [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-bd427e5e-a393-4a75-bdd8-d459645409a0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  774.215465] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  774.215768] env[65478]: DEBUG oslo_vmware.service [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-2ed2cf6f-238a-4756-a04a-0afe43ae04db {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  774.222452] env[65478]: DEBUG oslo_vmware.api [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Waiting for the task: (returnval){
[  774.222452] env[65478]:    value = "task-6011608"
[  774.222452] env[65478]:    _type = "Task"
[  774.222452] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  774.237898] env[65478]: DEBUG oslo_vmware.api [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Task: {'id': task-6011608, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  774.303022] env[65478]: DEBUG oslo_vmware.service [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ae0bbc8e-b2e9-48ac-a883-16ea215b5b7e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  774.311751] env[65478]: DEBUG oslo_vmware.service [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b9d61fb6-236a-4411-8166-068bb41414b0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  774.352873] env[65478]: DEBUG oslo_vmware.service [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-cf6f6cbd-5814-44f1-a431-f3095c912809 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  774.361243] env[65478]: DEBUG oslo_vmware.service [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-814da6be-1789-47e8-9d75-0b35d6573b50 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  774.380794] env[65478]: DEBUG nova.compute.provider_tree [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  774.466815] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ce3be817-83db-40e2-8cb2-67855105af19 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Lock "788343e6-5c24-4e9b-9c74-e14f3b179cdb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.362s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  774.478446] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Task: {'id': task-6011606, 'name': PowerOffVM_Task, 'duration_secs': 0.193223} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  774.478598] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] [instance: 95525483-b7db-427e-87b5-3f946972a250] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  774.478781] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] [instance: 95525483-b7db-427e-87b5-3f946972a250] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  774.479590] env[65478]: DEBUG oslo_vmware.service [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-fc9ba039-f388-4377-b042-9219f81730a5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  774.485925] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] [instance: 95525483-b7db-427e-87b5-3f946972a250] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  774.486168] env[65478]: DEBUG oslo_vmware.service [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-bbfaa6af-e71a-43d5-bc66-bf3ab7952dc6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  774.507600] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] [instance: 95525483-b7db-427e-87b5-3f946972a250] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  774.507795] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] [instance: 95525483-b7db-427e-87b5-3f946972a250] Deleting contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  774.507880] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Deleting the datastore file [datastore1] 95525483-b7db-427e-87b5-3f946972a250 {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  774.508146] env[65478]: DEBUG oslo_vmware.service [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-d914e473-6ffa-4409-a3f1-16751dc6bdbb {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  774.513814] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Waiting for the task: (returnval){
[  774.513814] env[65478]:    value = "task-6011610"
[  774.513814] env[65478]:    _type = "Task"
[  774.513814] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  774.521508] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Task: {'id': task-6011610, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  774.685070] env[65478]: DEBUG oslo_vmware.api [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Task: {'id': task-6011607, 'name': PowerOnVM_Task} progress is 1%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  774.737652] env[65478]: DEBUG oslo_vmware.api [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Task: {'id': task-6011608, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  774.885176] env[65478]: DEBUG nova.scheduler.client.report [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  774.918160] env[65478]: DEBUG nova.compute.manager [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  774.957572] env[65478]: DEBUG nova.virt.hardware [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  774.957811] env[65478]: DEBUG nova.virt.hardware [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  774.957934] env[65478]: DEBUG nova.virt.hardware [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  774.958168] env[65478]: DEBUG nova.virt.hardware [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  774.958337] env[65478]: DEBUG nova.virt.hardware [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  774.958498] env[65478]: DEBUG nova.virt.hardware [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  774.958741] env[65478]: DEBUG nova.virt.hardware [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  774.958929] env[65478]: DEBUG nova.virt.hardware [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  774.960177] env[65478]: DEBUG nova.virt.hardware [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  774.960177] env[65478]: DEBUG nova.virt.hardware [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  774.960177] env[65478]: DEBUG nova.virt.hardware [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  774.961259] env[65478]: DEBUG oslo_vmware.service [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-dd68f8b5-20de-4350-aa82-c5491d9b44f9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  774.969887] env[65478]: DEBUG oslo_vmware.service [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6ea26dce-afe3-4010-86b3-049b77b11255 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  775.022252] env[65478]: DEBUG nova.network.neutron [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  775.031455] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Task: {'id': task-6011610, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.095497} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  775.031455] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  775.031648] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] [instance: 95525483-b7db-427e-87b5-3f946972a250] Deleted contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  775.031648] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] [instance: 95525483-b7db-427e-87b5-3f946972a250] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  775.187586] env[65478]: DEBUG oslo_vmware.api [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Task: {'id': task-6011607, 'name': PowerOnVM_Task} progress is 64%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  775.238981] env[65478]: DEBUG oslo_vmware.api [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Task: {'id': task-6011608, 'name': PowerOffVM_Task, 'duration_secs': 0.954896} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  775.241162] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  775.241162] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  775.241162] env[65478]: DEBUG oslo_vmware.service [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-e28343e5-7b3b-4944-81be-9f26b0535e1a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  775.306355] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  775.306690] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Deleting contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  775.306741] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Deleting the datastore file [datastore1] 6a23cbd2-7031-484c-809e-436397029c7d {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  775.307034] env[65478]: DEBUG oslo_vmware.service [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-2fb7170c-2dc9-4b4b-bfb9-3bda253ebec4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  775.316168] env[65478]: DEBUG oslo_vmware.api [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Waiting for the task: (returnval){
[  775.316168] env[65478]:    value = "task-6011612"
[  775.316168] env[65478]:    _type = "Task"
[  775.316168] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  775.326901] env[65478]: DEBUG oslo_vmware.api [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Task: {'id': task-6011612, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  775.387981] env[65478]: DEBUG oslo_concurrency.lockutils [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.493s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  775.388663] env[65478]: DEBUG nova.compute.manager [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  775.392748] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.475s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  775.396224] env[65478]: INFO nova.compute.claims [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  775.687081] env[65478]: DEBUG oslo_vmware.api [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Task: {'id': task-6011607, 'name': PowerOnVM_Task, 'duration_secs': 1.378478} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  775.688111] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  775.688674] env[65478]: INFO nova.compute.manager [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Took 10.92 seconds to spawn the instance on the hypervisor.
[  775.688857] env[65478]: DEBUG nova.compute.manager [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  775.689833] env[65478]: DEBUG oslo_vmware.service [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f70e519b-3107-4736-86ea-089b9f714440 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  775.696017] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "c0545749-bc03-4f28-a0d4-ebaf55049095" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  775.696325] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "c0545749-bc03-4f28-a0d4-ebaf55049095" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  775.828120] env[65478]: DEBUG oslo_vmware.api [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Task: {'id': task-6011612, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.153415} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  775.828438] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  775.828438] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Deleted contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  775.828575] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  775.828700] env[65478]: INFO nova.compute.manager [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Took 1.63 seconds to destroy the instance on the hypervisor.
[  775.829803] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  775.830233] env[65478]: DEBUG nova.compute.manager [-] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[  775.830330] env[65478]: DEBUG nova.network.neutron [-] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[  775.830589] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  775.900435] env[65478]: DEBUG nova.compute.utils [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  775.906847] env[65478]: DEBUG nova.compute.manager [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Not allocating networking since 'none' was specified. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2039}}
[  775.922551] env[65478]: DEBUG nova.network.neutron [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Successfully updated port: 321b5f6a-6eb5-4a41-86a9-3eac3f4def7b {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  775.950868] env[65478]: WARNING neutronclient.v2_0.client [req-dffedb3c-e951-46fe-b087-6e0b5e969f9d req-fe74e6f7-6250-4c29-9842-96a6ffba719b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  776.071930] env[65478]: DEBUG nova.virt.hardware [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  776.072137] env[65478]: DEBUG nova.virt.hardware [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  776.072253] env[65478]: DEBUG nova.virt.hardware [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  776.072393] env[65478]: DEBUG nova.virt.hardware [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  776.072498] env[65478]: DEBUG nova.virt.hardware [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  776.072601] env[65478]: DEBUG nova.virt.hardware [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  776.072772] env[65478]: DEBUG nova.virt.hardware [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  776.072886] env[65478]: DEBUG nova.virt.hardware [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  776.073015] env[65478]: DEBUG nova.virt.hardware [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  776.073136] env[65478]: DEBUG nova.virt.hardware [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  776.073262] env[65478]: DEBUG nova.virt.hardware [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  776.074260] env[65478]: DEBUG oslo_vmware.service [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-01e7bcbd-8556-4928-aa17-fa7c63305459 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  776.083254] env[65478]: DEBUG oslo_vmware.service [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4035af00-a6d7-48b2-8115-8fe68b85487e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  776.098300] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] [instance: 95525483-b7db-427e-87b5-3f946972a250] Instance VIF info [] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  776.104984] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  776.105888] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 95525483-b7db-427e-87b5-3f946972a250] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  776.106446] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-5fdfae69-ba09-4157-82f5-43a7ff13c7cc {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  776.133236] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  776.133236] env[65478]:    value = "task-6011613"
[  776.133236] env[65478]:    _type = "Task"
[  776.133236] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  776.141449] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011613, 'name': CreateVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  776.162551] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  776.185329] env[65478]: WARNING neutronclient.v2_0.client [req-f9a18ee5-cf7d-4aa4-b03b-cb75cd334ba5 req-4a8a30f2-4eeb-4358-acd9-4307ed9101df service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  776.216895] env[65478]: INFO nova.compute.manager [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Took 16.13 seconds to build instance.
[  776.217998] env[65478]: DEBUG nova.compute.manager [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  776.410238] env[65478]: DEBUG nova.compute.manager [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  776.430613] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "refresh_cache-db37d828-c474-4577-816b-6fb2fcd9a82b" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  776.430613] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquired lock "refresh_cache-db37d828-c474-4577-816b-6fb2fcd9a82b" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  776.430707] env[65478]: DEBUG nova.network.neutron [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  776.649249] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011613, 'name': CreateVM_Task, 'duration_secs': 0.489675} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  776.649249] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 95525483-b7db-427e-87b5-3f946972a250] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  776.649608] env[65478]: DEBUG oslo_concurrency.lockutils [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  776.649728] env[65478]: DEBUG oslo_concurrency.lockutils [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  776.650032] env[65478]: DEBUG oslo_concurrency.lockutils [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Acquired external semaphore "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  776.650357] env[65478]: DEBUG oslo_vmware.service [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-0767d18a-95f0-4101-b5ac-e933823ebabf {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  776.654722] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Waiting for the task: (returnval){
[  776.654722] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]521b6508-f0ce-984f-b29c-2d5df28c7747"
[  776.654722] env[65478]:    _type = "Task"
[  776.654722] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  776.669515] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]521b6508-f0ce-984f-b29c-2d5df28c7747, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  776.721478] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7be8f3b0-52ce-4aa1-8406-1a9bbf5db177 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Lock "4821048b-4b5a-40b5-8888-f00dd28425d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.648s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  776.738115] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  776.758679] env[65478]: DEBUG oslo_vmware.service [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9c281748-b610-4b2a-9c0a-f319de96516e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  776.766538] env[65478]: DEBUG oslo_vmware.service [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-551a7919-0d04-485e-9a81-ba06938744f3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  776.801122] env[65478]: DEBUG oslo_vmware.service [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d841a8ee-1c06-4ea8-9f91-15662b00d2cd {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  776.809522] env[65478]: DEBUG oslo_vmware.service [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a9d482cb-1145-48b1-8cd7-fad63416739d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  776.824385] env[65478]: DEBUG nova.compute.provider_tree [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  776.981267] env[65478]: DEBUG nova.network.neutron [req-dffedb3c-e951-46fe-b087-6e0b5e969f9d req-fe74e6f7-6250-4c29-9842-96a6ffba719b service nova] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Updated VIF entry in instance network info cache for port 5c9a8578-bb94-4d72-acef-25b60278df21. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  776.981578] env[65478]: DEBUG nova.network.neutron [req-dffedb3c-e951-46fe-b087-6e0b5e969f9d req-fe74e6f7-6250-4c29-9842-96a6ffba719b service nova] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Updating instance_info_cache with network_info: [{"id": "5c9a8578-bb94-4d72-acef-25b60278df21", "address": "fa:16:3e:ae:3e:c3", "network": {"id": "f4cdd871-29d3-4e5f-9c28-ce69831a9d5b", "bridge": "br-int", "label": "tempest-FloatingIPsAssociationNegativeTestJSON-434449668-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "99bc07d4a2be4da3b5bb4900ea76450b", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "c68b7663-4f0e-47f0-ac7f-40c6d952f7bb", "external-id": "nsx-vlan-transportzone-696", "segmentation_id": 696, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap5c9a8578-bb", "ovs_interfaceid": "5c9a8578-bb94-4d72-acef-25b60278df21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  777.164713] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]521b6508-f0ce-984f-b29c-2d5df28c7747, 'name': SearchDatastore_Task, 'duration_secs': 0.010616} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  777.164882] env[65478]: DEBUG oslo_concurrency.lockutils [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  777.167887] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] [instance: 95525483-b7db-427e-87b5-3f946972a250] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  777.167887] env[65478]: DEBUG oslo_concurrency.lockutils [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  777.168030] env[65478]: DEBUG oslo_concurrency.lockutils [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  777.168118] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Creating directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  777.168379] env[65478]: DEBUG oslo_vmware.service [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Invoking FileManager.MakeDirectory with opID=oslo.vmware-64330dc5-985a-47c6-afc5-1bd702441049 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  777.176626] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Created directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  777.176784] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Folder [datastore1] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  777.177616] env[65478]: DEBUG oslo_vmware.service [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-3a5f36ff-31c5-4761-bc83-58e7095999c7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  777.182878] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Waiting for the task: (returnval){
[  777.182878] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]526af103-97aa-fa39-ca14-71388fee416b"
[  777.182878] env[65478]:    _type = "Task"
[  777.182878] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  777.192415] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]526af103-97aa-fa39-ca14-71388fee416b, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  777.300226] env[65478]: WARNING neutronclient.v2_0.client [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  777.329839] env[65478]: DEBUG nova.scheduler.client.report [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  777.343154] env[65478]: DEBUG nova.network.neutron [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  777.403216] env[65478]: DEBUG nova.network.neutron [req-f9a18ee5-cf7d-4aa4-b03b-cb75cd334ba5 req-4a8a30f2-4eeb-4358-acd9-4307ed9101df service nova] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Updated VIF entry in instance network info cache for port c753d998-c733-4ef7-b4fc-008c7024f5ef. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  777.403568] env[65478]: DEBUG nova.network.neutron [req-f9a18ee5-cf7d-4aa4-b03b-cb75cd334ba5 req-4a8a30f2-4eeb-4358-acd9-4307ed9101df service nova] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Updating instance_info_cache with network_info: [{"id": "c753d998-c733-4ef7-b4fc-008c7024f5ef", "address": "fa:16:3e:18:92:82", "network": {"id": "8419dcc5-ccb7-4667-a5ee-3f07016ddecd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "eb20b7ec77e847179c9940510a8b48bf", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "ec3f9e71-839a-429d-b211-d3dfc98ca4f6", "external-id": "nsx-vlan-transportzone-5", "segmentation_id": 5, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapc753d998-c7", "ovs_interfaceid": "c753d998-c733-4ef7-b4fc-008c7024f5ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  777.423190] env[65478]: DEBUG nova.compute.manager [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  777.464072] env[65478]: DEBUG nova.virt.hardware [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  777.464353] env[65478]: DEBUG nova.virt.hardware [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  777.464453] env[65478]: DEBUG nova.virt.hardware [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  777.464510] env[65478]: DEBUG nova.virt.hardware [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  777.464602] env[65478]: DEBUG nova.virt.hardware [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  777.464706] env[65478]: DEBUG nova.virt.hardware [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  777.464873] env[65478]: DEBUG nova.virt.hardware [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  777.464991] env[65478]: DEBUG nova.virt.hardware [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  777.465402] env[65478]: DEBUG nova.virt.hardware [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  777.465488] env[65478]: DEBUG nova.virt.hardware [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  777.466465] env[65478]: DEBUG nova.virt.hardware [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  777.468111] env[65478]: DEBUG oslo_vmware.service [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-513a50f6-ac8e-48cd-bd38-74a31672b448 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  777.479365] env[65478]: DEBUG oslo_vmware.service [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-cab90095-dcc1-49c8-b8dd-42c5901f8456 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  777.486051] env[65478]: DEBUG oslo_concurrency.lockutils [req-dffedb3c-e951-46fe-b087-6e0b5e969f9d req-fe74e6f7-6250-4c29-9842-96a6ffba719b service nova] Releasing lock "refresh_cache-eb076624-c76c-47da-9320-5fc13a51b365" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  777.486376] env[65478]: DEBUG nova.compute.manager [req-dffedb3c-e951-46fe-b087-6e0b5e969f9d req-fe74e6f7-6250-4c29-9842-96a6ffba719b service nova] [instance: c444ace8-9651-4df8-8604-982300643449] Received event network-vif-deleted-608f553d-b692-4674-bf3c-7e763f2fd6cc {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  777.498545] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Instance VIF info [] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  777.508210] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Creating folder: Project (83694f1109504372b48f086ead1a8991). Parent ref: group-v1161186. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  777.508707] env[65478]: DEBUG oslo_vmware.service [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-05a5b8ff-ab1c-478f-bd30-6cb99bf8bc26 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  777.514076] env[65478]: DEBUG nova.network.neutron [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Updating instance_info_cache with network_info: [{"id": "a4636485-7b6f-4fbb-ab94-d4f75ada7a1c", "address": "fa:16:3e:bc:0f:ab", "network": {"id": "432219d2-eada-4b7b-82da-1951de930922", "bridge": "br-int", "label": "tempest-AttachInterfacesUnderV243Test-1661348426-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "1f872aa3128c4866aed16d152b15486f", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "8b1a0b17-d008-4a8b-be2a-796ff1a9a2d1", "external-id": "nsx-vlan-transportzone-880", "segmentation_id": 880, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapa4636485-7b", "ovs_interfaceid": "a4636485-7b6f-4fbb-ab94-d4f75ada7a1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  777.526018] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Created folder: Project (83694f1109504372b48f086ead1a8991) in parent group-v1161186.
[  777.526018] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Creating folder: Instances. Parent ref: group-v1161242. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  777.526018] env[65478]: DEBUG oslo_vmware.service [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-3a7c4513-9ea9-42e5-a367-c2a8787c3e68 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  777.536166] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Created folder: Instances in parent group-v1161242.
[  777.536797] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  777.537427] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  777.537754] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-43bc74c0-60b4-4a6c-bc11-f3f3632fdbe5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  777.559064] env[65478]: WARNING neutronclient.v2_0.client [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  777.562945] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  777.562945] env[65478]:    value = "task-6011616"
[  777.562945] env[65478]:    _type = "Task"
[  777.562945] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  777.572468] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011616, 'name': CreateVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  777.643147] env[65478]: DEBUG nova.network.neutron [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Updating instance_info_cache with network_info: [{"id": "321b5f6a-6eb5-4a41-86a9-3eac3f4def7b", "address": "fa:16:3e:16:7e:3c", "network": {"id": "e45f1f2f-7a0a-48b3-b75d-d13d6be57474", "bridge": "br-int", "label": "tempest-ServersAdminTestJSON-393396284-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a8a09b6e5ab3418e871f2d26fcd10a07", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "3c92f34c-1dd7-4dc5-b8e8-f6c55cc5b4b8", "external-id": "nsx-vlan-transportzone-850", "segmentation_id": 850, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap321b5f6a-6e", "ovs_interfaceid": "321b5f6a-6eb5-4a41-86a9-3eac3f4def7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  777.696629] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]526af103-97aa-fa39-ca14-71388fee416b, 'name': SearchDatastore_Task, 'duration_secs': 0.015737} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  777.697958] env[65478]: DEBUG oslo_vmware.service [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-40a2141b-53f6-4d3d-b842-dac3731e7ccc {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  777.704285] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Waiting for the task: (returnval){
[  777.704285] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]521edc2d-242d-2b45-6561-6568feca36a8"
[  777.704285] env[65478]:    _type = "Task"
[  777.704285] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  777.712728] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]521edc2d-242d-2b45-6561-6568feca36a8, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  777.811105] env[65478]: DEBUG nova.network.neutron [-] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  777.835208] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.446s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  777.835934] env[65478]: DEBUG nova.compute.manager [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  777.840373] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.574s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  777.842367] env[65478]: INFO nova.compute.claims [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  777.909704] env[65478]: DEBUG oslo_concurrency.lockutils [req-f9a18ee5-cf7d-4aa4-b03b-cb75cd334ba5 req-4a8a30f2-4eeb-4358-acd9-4307ed9101df service nova] Releasing lock "refresh_cache-788343e6-5c24-4e9b-9c74-e14f3b179cdb" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  777.910245] env[65478]: DEBUG nova.compute.manager [req-f9a18ee5-cf7d-4aa4-b03b-cb75cd334ba5 req-4a8a30f2-4eeb-4358-acd9-4307ed9101df service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Received event network-changed-457c1734-c99a-4d71-a200-0341a9e3bdd8 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  777.911047] env[65478]: DEBUG nova.compute.manager [req-f9a18ee5-cf7d-4aa4-b03b-cb75cd334ba5 req-4a8a30f2-4eeb-4358-acd9-4307ed9101df service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Refreshing instance network info cache due to event network-changed-457c1734-c99a-4d71-a200-0341a9e3bdd8. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  777.911047] env[65478]: DEBUG oslo_concurrency.lockutils [req-f9a18ee5-cf7d-4aa4-b03b-cb75cd334ba5 req-4a8a30f2-4eeb-4358-acd9-4307ed9101df service nova] Acquiring lock "refresh_cache-caf7856c-4e51-4e6c-ad32-2088e15d5d8f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  777.911047] env[65478]: DEBUG oslo_concurrency.lockutils [req-f9a18ee5-cf7d-4aa4-b03b-cb75cd334ba5 req-4a8a30f2-4eeb-4358-acd9-4307ed9101df service nova] Acquired lock "refresh_cache-caf7856c-4e51-4e6c-ad32-2088e15d5d8f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  777.911047] env[65478]: DEBUG nova.network.neutron [req-f9a18ee5-cf7d-4aa4-b03b-cb75cd334ba5 req-4a8a30f2-4eeb-4358-acd9-4307ed9101df service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Refreshing network info cache for port 457c1734-c99a-4d71-a200-0341a9e3bdd8 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  778.019711] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Releasing lock "refresh_cache-d978e71d-2c30-4a76-b000-6ddf3203ab10" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  778.019711] env[65478]: DEBUG nova.compute.manager [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Instance network_info: |[{"id": "a4636485-7b6f-4fbb-ab94-d4f75ada7a1c", "address": "fa:16:3e:bc:0f:ab", "network": {"id": "432219d2-eada-4b7b-82da-1951de930922", "bridge": "br-int", "label": "tempest-AttachInterfacesUnderV243Test-1661348426-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "1f872aa3128c4866aed16d152b15486f", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "8b1a0b17-d008-4a8b-be2a-796ff1a9a2d1", "external-id": "nsx-vlan-transportzone-880", "segmentation_id": 880, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapa4636485-7b", "ovs_interfaceid": "a4636485-7b6f-4fbb-ab94-d4f75ada7a1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  778.020047] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:bc:0f:ab', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': '8b1a0b17-d008-4a8b-be2a-796ff1a9a2d1', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': 'a4636485-7b6f-4fbb-ab94-d4f75ada7a1c', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  778.028268] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Creating folder: Project (1f872aa3128c4866aed16d152b15486f). Parent ref: group-v1161186. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  778.028637] env[65478]: DEBUG oslo_vmware.service [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-e4e4ac42-b8ed-4329-a416-fe8891039150 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  778.038121] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Created folder: Project (1f872aa3128c4866aed16d152b15486f) in parent group-v1161186.
[  778.038355] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Creating folder: Instances. Parent ref: group-v1161245. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  778.038622] env[65478]: DEBUG oslo_vmware.service [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-93f657c4-4ec4-4572-90b3-5ddd63bba6c1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  778.046925] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Created folder: Instances in parent group-v1161245.
[  778.047486] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  778.048201] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  778.048546] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-01092d61-fe7f-4591-b43d-d78a8cbdca7c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  778.085777] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011616, 'name': CreateVM_Task, 'duration_secs': 0.407808} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  778.085777] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  778.087271] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  778.087271] env[65478]:    value = "task-6011619"
[  778.087271] env[65478]:    _type = "Task"
[  778.087271] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  778.094667] env[65478]: DEBUG oslo_concurrency.lockutils [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  778.098698] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011619, 'name': CreateVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  778.099221] env[65478]: DEBUG oslo_concurrency.lockutils [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  778.101697] env[65478]: DEBUG oslo_concurrency.lockutils [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Acquired external semaphore "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  778.101697] env[65478]: DEBUG oslo_vmware.service [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-cb0a4642-ec02-421b-87a0-ed04b437e076 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  778.108033] env[65478]: DEBUG oslo_vmware.api [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Waiting for the task: (returnval){
[  778.108033] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]524597da-5d87-118b-32b8-af068a637f55"
[  778.108033] env[65478]:    _type = "Task"
[  778.108033] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  778.125578] env[65478]: DEBUG oslo_vmware.api [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]524597da-5d87-118b-32b8-af068a637f55, 'name': SearchDatastore_Task, 'duration_secs': 0.010759} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  778.125578] env[65478]: DEBUG oslo_concurrency.lockutils [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  778.125578] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  778.125578] env[65478]: DEBUG oslo_concurrency.lockutils [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  778.146814] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Releasing lock "refresh_cache-db37d828-c474-4577-816b-6fb2fcd9a82b" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  778.147174] env[65478]: DEBUG nova.compute.manager [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Instance network_info: |[{"id": "321b5f6a-6eb5-4a41-86a9-3eac3f4def7b", "address": "fa:16:3e:16:7e:3c", "network": {"id": "e45f1f2f-7a0a-48b3-b75d-d13d6be57474", "bridge": "br-int", "label": "tempest-ServersAdminTestJSON-393396284-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a8a09b6e5ab3418e871f2d26fcd10a07", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "3c92f34c-1dd7-4dc5-b8e8-f6c55cc5b4b8", "external-id": "nsx-vlan-transportzone-850", "segmentation_id": 850, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap321b5f6a-6e", "ovs_interfaceid": "321b5f6a-6eb5-4a41-86a9-3eac3f4def7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  778.151071] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:16:7e:3c', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': '3c92f34c-1dd7-4dc5-b8e8-f6c55cc5b4b8', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': '321b5f6a-6eb5-4a41-86a9-3eac3f4def7b', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  778.160271] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Creating folder: Project (a8a09b6e5ab3418e871f2d26fcd10a07). Parent ref: group-v1161186. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  778.160949] env[65478]: DEBUG oslo_vmware.service [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-29e04842-8708-4f51-9ba9-899bf463f6a1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  778.170336] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Created folder: Project (a8a09b6e5ab3418e871f2d26fcd10a07) in parent group-v1161186.
[  778.170503] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Creating folder: Instances. Parent ref: group-v1161248. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  778.171093] env[65478]: DEBUG oslo_vmware.service [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-f0aa04c1-cbd1-48c1-9d83-5bdffc994144 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  778.180450] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Created folder: Instances in parent group-v1161248.
[  778.181197] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  778.181808] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  778.182103] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-8b12296d-1bfa-4d13-b016-0b92b22469ae {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  778.211531] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  778.211531] env[65478]:    value = "task-6011622"
[  778.211531] env[65478]:    _type = "Task"
[  778.211531] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  778.220657] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]521edc2d-242d-2b45-6561-6568feca36a8, 'name': SearchDatastore_Task, 'duration_secs': 0.010167} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  778.221271] env[65478]: DEBUG oslo_concurrency.lockutils [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  778.221628] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Copying Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 95525483-b7db-427e-87b5-3f946972a250/95525483-b7db-427e-87b5-3f946972a250.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  778.221970] env[65478]: DEBUG oslo_vmware.service [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-a336cac0-0112-463a-8bd6-22a4f98b8835 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  778.224687] env[65478]: DEBUG oslo_concurrency.lockutils [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  778.224987] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Creating directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  778.229296] env[65478]: DEBUG oslo_vmware.service [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-ad0569ca-83de-4909-896e-ea9157dadcd6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  778.232900] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011622, 'name': CreateVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  778.234064] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Waiting for the task: (returnval){
[  778.234064] env[65478]:    value = "task-6011623"
[  778.234064] env[65478]:    _type = "Task"
[  778.234064] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  778.240156] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Created directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  778.241583] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Folder [datastore1] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  778.244485] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Task: {'id': task-6011623, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  778.244781] env[65478]: DEBUG oslo_vmware.service [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-3272fb4f-c5b0-4c26-a1a4-251556e5e79b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  778.254047] env[65478]: DEBUG oslo_vmware.api [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Waiting for the task: (returnval){
[  778.254047] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]528fa0fa-b572-4bf9-6494-7acc4dc08bc6"
[  778.254047] env[65478]:    _type = "Task"
[  778.254047] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  778.265077] env[65478]: DEBUG oslo_vmware.api [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]528fa0fa-b572-4bf9-6494-7acc4dc08bc6, 'name': SearchDatastore_Task, 'duration_secs': 0.009162} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  778.266936] env[65478]: DEBUG oslo_vmware.service [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-10faf814-f4a4-45de-9ef9-321ec019976d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  778.271552] env[65478]: DEBUG oslo_vmware.api [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Waiting for the task: (returnval){
[  778.271552] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52b7ac04-af9e-7cd0-5359-a03c6fa65444"
[  778.271552] env[65478]:    _type = "Task"
[  778.271552] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  778.280144] env[65478]: DEBUG oslo_vmware.api [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52b7ac04-af9e-7cd0-5359-a03c6fa65444, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  778.289965] env[65478]: DEBUG nova.compute.manager [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Received event network-vif-plugged-b7d6d7e2-7876-4997-af0e-f826ba3ca090 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  778.290593] env[65478]: DEBUG oslo_concurrency.lockutils [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] Acquiring lock "f01c577a-3995-465a-98ae-21880df54cc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  778.291567] env[65478]: DEBUG oslo_concurrency.lockutils [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] Lock "f01c577a-3995-465a-98ae-21880df54cc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  778.291567] env[65478]: DEBUG oslo_concurrency.lockutils [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] Lock "f01c577a-3995-465a-98ae-21880df54cc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  778.291567] env[65478]: DEBUG nova.compute.manager [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] [instance: f01c577a-3995-465a-98ae-21880df54cc0] No waiting events found dispatching network-vif-plugged-b7d6d7e2-7876-4997-af0e-f826ba3ca090 {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  778.291567] env[65478]: WARNING nova.compute.manager [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Received unexpected event network-vif-plugged-b7d6d7e2-7876-4997-af0e-f826ba3ca090 for instance with vm_state active and task_state None.
[  778.291567] env[65478]: DEBUG nova.compute.manager [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Received event network-changed-b7d6d7e2-7876-4997-af0e-f826ba3ca090 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  778.292523] env[65478]: DEBUG nova.compute.manager [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Refreshing instance network info cache due to event network-changed-b7d6d7e2-7876-4997-af0e-f826ba3ca090. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  778.292523] env[65478]: DEBUG oslo_concurrency.lockutils [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] Acquiring lock "refresh_cache-f01c577a-3995-465a-98ae-21880df54cc0" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  778.292523] env[65478]: DEBUG oslo_concurrency.lockutils [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] Acquired lock "refresh_cache-f01c577a-3995-465a-98ae-21880df54cc0" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  778.292523] env[65478]: DEBUG nova.network.neutron [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Refreshing network info cache for port b7d6d7e2-7876-4997-af0e-f826ba3ca090 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  778.313618] env[65478]: INFO nova.compute.manager [-] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Took 2.48 seconds to deallocate network for instance.
[  778.350896] env[65478]: DEBUG nova.compute.utils [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  778.356051] env[65478]: DEBUG nova.compute.manager [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  778.357329] env[65478]: DEBUG nova.network.neutron [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  778.358504] env[65478]: WARNING neutronclient.v2_0.client [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  778.359422] env[65478]: WARNING neutronclient.v2_0.client [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  778.414959] env[65478]: WARNING neutronclient.v2_0.client [req-f9a18ee5-cf7d-4aa4-b03b-cb75cd334ba5 req-4a8a30f2-4eeb-4358-acd9-4307ed9101df service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  778.489188] env[65478]: DEBUG nova.policy [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '347fb9df152540528410e3ff102010c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de0dd2b26b24b4fb6e13f475974035a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  778.604975] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011619, 'name': CreateVM_Task, 'duration_secs': 0.346832} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  778.604975] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  778.605795] env[65478]: WARNING neutronclient.v2_0.client [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  778.605795] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  778.605795] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  778.606069] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Acquired external semaphore "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  778.608638] env[65478]: DEBUG oslo_vmware.service [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-6540f512-f8a7-4c40-a278-ca5e829b980a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  778.615509] env[65478]: DEBUG oslo_vmware.api [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Waiting for the task: (returnval){
[  778.615509] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]524d23ad-775e-5d95-8b3f-588277c2e018"
[  778.615509] env[65478]:    _type = "Task"
[  778.615509] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  778.627073] env[65478]: DEBUG oslo_vmware.api [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]524d23ad-775e-5d95-8b3f-588277c2e018, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  778.727915] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011622, 'name': CreateVM_Task} progress is 99%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  778.747304] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Task: {'id': task-6011623, 'name': CopyVirtualDisk_Task} progress is 77%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  778.784552] env[65478]: DEBUG oslo_vmware.api [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52b7ac04-af9e-7cd0-5359-a03c6fa65444, 'name': SearchDatastore_Task, 'duration_secs': 0.009296} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  778.784552] env[65478]: DEBUG oslo_concurrency.lockutils [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  778.784852] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Copying Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3/4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  778.785052] env[65478]: DEBUG oslo_vmware.service [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-c82a49b7-9b88-4646-86ff-704ab93cc513 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  778.794091] env[65478]: DEBUG oslo_vmware.api [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Waiting for the task: (returnval){
[  778.794091] env[65478]:    value = "task-6011624"
[  778.794091] env[65478]:    _type = "Task"
[  778.794091] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  778.798979] env[65478]: WARNING neutronclient.v2_0.client [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  778.808278] env[65478]: DEBUG oslo_vmware.api [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011624, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  778.830230] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  778.871102] env[65478]: DEBUG nova.compute.manager [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  778.879478] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Acquiring lock "9b286a00-af27-4012-a596-45bbe98da254" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  778.879700] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lock "9b286a00-af27-4012-a596-45bbe98da254" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  779.080844] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  779.081914] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  779.083139] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  779.083380] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  779.083687] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  779.084559] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  779.087841] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  779.088961] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[  779.089172] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  779.129633] env[65478]: DEBUG oslo_vmware.api [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]524d23ad-775e-5d95-8b3f-588277c2e018, 'name': SearchDatastore_Task, 'duration_secs': 0.061798} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  779.129633] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  779.129759] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  779.129928] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  779.129989] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  779.130737] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Creating directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  779.131042] env[65478]: DEBUG oslo_vmware.service [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-7cf59d63-b5dd-4134-a76f-8dbe6bf4d6da {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  779.151086] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Created directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  779.151086] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Folder [datastore1] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  779.152307] env[65478]: DEBUG oslo_vmware.service [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-88c0adaf-d31b-48fe-8dcc-7c63e35b2bc8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  779.165459] env[65478]: DEBUG oslo_vmware.api [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Waiting for the task: (returnval){
[  779.165459] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52374fa6-6f15-05eb-9f99-774312d49cb7"
[  779.165459] env[65478]:    _type = "Task"
[  779.165459] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  779.182387] env[65478]: DEBUG oslo_vmware.api [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52374fa6-6f15-05eb-9f99-774312d49cb7, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  779.229415] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011622, 'name': CreateVM_Task} progress is 99%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  779.255755] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Task: {'id': task-6011623, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.540214} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  779.256042] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Copied Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 95525483-b7db-427e-87b5-3f946972a250/95525483-b7db-427e-87b5-3f946972a250.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  779.256266] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] [instance: 95525483-b7db-427e-87b5-3f946972a250] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  779.256540] env[65478]: DEBUG oslo_vmware.service [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-03c008fd-c8d1-4f4f-b025-c7474a81551d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  779.266589] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Waiting for the task: (returnval){
[  779.266589] env[65478]:    value = "task-6011625"
[  779.266589] env[65478]:    _type = "Task"
[  779.266589] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  779.279334] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Task: {'id': task-6011625, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  779.312114] env[65478]: DEBUG oslo_vmware.api [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011624, 'name': CopyVirtualDisk_Task} progress is 89%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  779.360023] env[65478]: DEBUG oslo_vmware.service [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a4e13e22-7502-4982-bbea-df521283ca01 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  779.370217] env[65478]: DEBUG oslo_vmware.service [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-aa74db44-386d-4a7f-8234-f60a447b4180 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  779.387550] env[65478]: DEBUG nova.compute.manager [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  779.401073] env[65478]: DEBUG nova.network.neutron [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Successfully created port: 60d749ab-453c-414e-a511-3bb1b9f041d0 {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  779.422095] env[65478]: DEBUG oslo_vmware.service [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-5f54e5f8-2186-4810-8a21-f9a408782624 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  779.434077] env[65478]: WARNING neutronclient.v2_0.client [req-f9a18ee5-cf7d-4aa4-b03b-cb75cd334ba5 req-4a8a30f2-4eeb-4358-acd9-4307ed9101df service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  779.444668] env[65478]: DEBUG oslo_vmware.service [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4a7c4144-3018-46be-837e-e4891c5a89f2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  779.460763] env[65478]: DEBUG nova.compute.provider_tree [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  779.583776] env[65478]: WARNING neutronclient.v2_0.client [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  779.594085] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  779.671687] env[65478]: DEBUG nova.network.neutron [req-f9a18ee5-cf7d-4aa4-b03b-cb75cd334ba5 req-4a8a30f2-4eeb-4358-acd9-4307ed9101df service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Updated VIF entry in instance network info cache for port 457c1734-c99a-4d71-a200-0341a9e3bdd8. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  779.672439] env[65478]: DEBUG nova.network.neutron [req-f9a18ee5-cf7d-4aa4-b03b-cb75cd334ba5 req-4a8a30f2-4eeb-4358-acd9-4307ed9101df service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Updating instance_info_cache with network_info: [{"id": "457c1734-c99a-4d71-a200-0341a9e3bdd8", "address": "fa:16:3e:90:77:31", "network": {"id": "eab0e877-79ef-45b8-a26f-7dd517a13b53", "bridge": "br-int", "label": "tempest-FloatingIPsAssociationTestJSON-364284774-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "7dd8c4cd35c44466b1991950f28d886b", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "054fcd1e-638e-425a-a1de-78cb188ae026", "external-id": "nsx-vlan-transportzone-658", "segmentation_id": 658, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap457c1734-c9", "ovs_interfaceid": "457c1734-c99a-4d71-a200-0341a9e3bdd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  779.677202] env[65478]: DEBUG oslo_vmware.api [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52374fa6-6f15-05eb-9f99-774312d49cb7, 'name': SearchDatastore_Task, 'duration_secs': 0.064412} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  779.678081] env[65478]: DEBUG oslo_vmware.service [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-97fc0a0d-17ee-4454-a42a-764e9267b9a7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  779.684484] env[65478]: DEBUG oslo_vmware.api [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Waiting for the task: (returnval){
[  779.684484] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]525e4bd1-3e03-a0d3-7859-9c5117c32d8a"
[  779.684484] env[65478]:    _type = "Task"
[  779.684484] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  779.692912] env[65478]: DEBUG oslo_vmware.api [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]525e4bd1-3e03-a0d3-7859-9c5117c32d8a, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  779.724154] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011622, 'name': CreateVM_Task, 'duration_secs': 1.456591} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  779.724329] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  779.725587] env[65478]: WARNING neutronclient.v2_0.client [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  779.725664] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  779.725797] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  779.726087] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquired external semaphore "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  779.726368] env[65478]: DEBUG oslo_vmware.service [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-4bc5e26f-37c4-4e15-8989-00c24d0ba1ba {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  779.731150] env[65478]: DEBUG oslo_vmware.api [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[  779.731150] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]521dbef6-6425-ac0c-4d1b-8560fe4f326b"
[  779.731150] env[65478]:    _type = "Task"
[  779.731150] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  779.740836] env[65478]: DEBUG oslo_vmware.api [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]521dbef6-6425-ac0c-4d1b-8560fe4f326b, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  779.775372] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Task: {'id': task-6011625, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.078141} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  779.775573] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] [instance: 95525483-b7db-427e-87b5-3f946972a250] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  779.776341] env[65478]: DEBUG oslo_vmware.service [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c9677042-673d-483d-86e9-22ee5d2ae799 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  779.796545] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] [instance: 95525483-b7db-427e-87b5-3f946972a250] Reconfiguring VM instance instance-00000008 to attach disk [datastore1] 95525483-b7db-427e-87b5-3f946972a250/95525483-b7db-427e-87b5-3f946972a250.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  779.796828] env[65478]: DEBUG nova.network.neutron [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Updated VIF entry in instance network info cache for port b7d6d7e2-7876-4997-af0e-f826ba3ca090. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  779.797141] env[65478]: DEBUG nova.network.neutron [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Updating instance_info_cache with network_info: [{"id": "b7d6d7e2-7876-4997-af0e-f826ba3ca090", "address": "fa:16:3e:c1:b1:be", "network": {"id": "31194553-028e-4d05-9ab4-3398c78882fd", "bridge": "br-int", "label": "tempest-ImagesNegativeTestJSON-1509320111-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "80611f96bf484271ac3c324b95295982", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "5e1049e8-c06b-4c93-a9e1-2cbb530f3f95", "external-id": "nsx-vlan-transportzone-966", "segmentation_id": 966, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapb7d6d7e2-78", "ovs_interfaceid": "b7d6d7e2-7876-4997-af0e-f826ba3ca090", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  779.799696] env[65478]: DEBUG oslo_vmware.service [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-66d1e499-67ac-41d4-902e-6612b4370bf5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  779.823117] env[65478]: DEBUG oslo_vmware.api [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011624, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.523768} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  779.823376] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Copied Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3/4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  779.825061] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Waiting for the task: (returnval){
[  779.825061] env[65478]:    value = "task-6011626"
[  779.825061] env[65478]:    _type = "Task"
[  779.825061] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  779.829036] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  779.829387] env[65478]: DEBUG oslo_vmware.service [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-f833c266-c4b0-4714-82fd-fcd9810bafbb {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  779.835105] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Task: {'id': task-6011626, 'name': ReconfigVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  779.838360] env[65478]: DEBUG oslo_vmware.api [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Waiting for the task: (returnval){
[  779.838360] env[65478]:    value = "task-6011627"
[  779.838360] env[65478]:    _type = "Task"
[  779.838360] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  779.846250] env[65478]: DEBUG oslo_vmware.api [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011627, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  779.942553] env[65478]: DEBUG nova.compute.manager [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  779.963021] env[65478]: DEBUG nova.scheduler.client.report [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  779.969167] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  779.979778] env[65478]: DEBUG nova.virt.hardware [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  779.980092] env[65478]: DEBUG nova.virt.hardware [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  779.980274] env[65478]: DEBUG nova.virt.hardware [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  779.980513] env[65478]: DEBUG nova.virt.hardware [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  779.980611] env[65478]: DEBUG nova.virt.hardware [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  779.980727] env[65478]: DEBUG nova.virt.hardware [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  779.980943] env[65478]: DEBUG nova.virt.hardware [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  779.981139] env[65478]: DEBUG nova.virt.hardware [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  779.981474] env[65478]: DEBUG nova.virt.hardware [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  779.981565] env[65478]: DEBUG nova.virt.hardware [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  779.981735] env[65478]: DEBUG nova.virt.hardware [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  779.982734] env[65478]: DEBUG oslo_vmware.service [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e760e8c7-e2f5-4f37-afc7-8d69016e496c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  779.990216] env[65478]: DEBUG oslo_vmware.service [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c04a7933-0637-4364-9c93-9971c6583704 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  780.125116] env[65478]: DEBUG nova.compute.manager [req-a519318f-c843-4907-98aa-c430b986dd04 req-9b0f662a-ebf8-48b8-b418-afe23824734d service nova] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Received event network-changed-2fb52993-7218-432a-bea9-5337867a80b6 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  780.125768] env[65478]: DEBUG nova.compute.manager [req-a519318f-c843-4907-98aa-c430b986dd04 req-9b0f662a-ebf8-48b8-b418-afe23824734d service nova] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Refreshing instance network info cache due to event network-changed-2fb52993-7218-432a-bea9-5337867a80b6. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  780.125952] env[65478]: DEBUG oslo_concurrency.lockutils [req-a519318f-c843-4907-98aa-c430b986dd04 req-9b0f662a-ebf8-48b8-b418-afe23824734d service nova] Acquiring lock "refresh_cache-4f7fb80a-cb05-4bd5-bb10-380d95b2e892" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  780.126085] env[65478]: DEBUG oslo_concurrency.lockutils [req-a519318f-c843-4907-98aa-c430b986dd04 req-9b0f662a-ebf8-48b8-b418-afe23824734d service nova] Acquired lock "refresh_cache-4f7fb80a-cb05-4bd5-bb10-380d95b2e892" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  780.126196] env[65478]: DEBUG nova.network.neutron [req-a519318f-c843-4907-98aa-c430b986dd04 req-9b0f662a-ebf8-48b8-b418-afe23824734d service nova] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Refreshing network info cache for port 2fb52993-7218-432a-bea9-5337867a80b6 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  780.179597] env[65478]: DEBUG oslo_concurrency.lockutils [req-f9a18ee5-cf7d-4aa4-b03b-cb75cd334ba5 req-4a8a30f2-4eeb-4358-acd9-4307ed9101df service nova] Releasing lock "refresh_cache-caf7856c-4e51-4e6c-ad32-2088e15d5d8f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  780.194356] env[65478]: DEBUG oslo_vmware.api [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]525e4bd1-3e03-a0d3-7859-9c5117c32d8a, 'name': SearchDatastore_Task, 'duration_secs': 0.008718} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  780.194721] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  780.194795] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Copying Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] d978e71d-2c30-4a76-b000-6ddf3203ab10/d978e71d-2c30-4a76-b000-6ddf3203ab10.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  780.195150] env[65478]: DEBUG oslo_vmware.service [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-c6befa16-cf7f-4417-9dc8-76701e07fd51 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  780.201347] env[65478]: DEBUG oslo_vmware.api [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Waiting for the task: (returnval){
[  780.201347] env[65478]:    value = "task-6011628"
[  780.201347] env[65478]:    _type = "Task"
[  780.201347] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  780.209666] env[65478]: DEBUG oslo_vmware.api [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Task: {'id': task-6011628, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  780.242439] env[65478]: DEBUG oslo_vmware.api [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]521dbef6-6425-ac0c-4d1b-8560fe4f326b, 'name': SearchDatastore_Task, 'duration_secs': 0.008364} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  780.242819] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  780.243399] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  780.243399] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  780.243607] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  780.243771] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Creating directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  780.244077] env[65478]: DEBUG oslo_vmware.service [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-f6cb875c-9cd1-4ffc-9ec3-ec677dd57d1b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  780.251488] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Created directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  780.251670] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Folder [datastore1] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  780.252463] env[65478]: DEBUG oslo_vmware.service [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-9d09f4a2-b986-408f-ae97-34c043a3864c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  780.258469] env[65478]: DEBUG oslo_vmware.api [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[  780.258469] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c1d251-905d-fe78-ca68-23241d2a1583"
[  780.258469] env[65478]:    _type = "Task"
[  780.258469] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  780.267397] env[65478]: DEBUG oslo_vmware.api [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c1d251-905d-fe78-ca68-23241d2a1583, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  780.314026] env[65478]: DEBUG oslo_concurrency.lockutils [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] Releasing lock "refresh_cache-f01c577a-3995-465a-98ae-21880df54cc0" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  780.314328] env[65478]: DEBUG nova.compute.manager [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Received event network-vif-plugged-e599424e-fe74-4d2c-948c-3759b6289f44 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  780.314589] env[65478]: DEBUG oslo_concurrency.lockutils [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] Acquiring lock "4821048b-4b5a-40b5-8888-f00dd28425d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  780.314819] env[65478]: DEBUG oslo_concurrency.lockutils [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] Lock "4821048b-4b5a-40b5-8888-f00dd28425d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  780.314974] env[65478]: DEBUG oslo_concurrency.lockutils [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] Lock "4821048b-4b5a-40b5-8888-f00dd28425d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  780.315146] env[65478]: DEBUG nova.compute.manager [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] No waiting events found dispatching network-vif-plugged-e599424e-fe74-4d2c-948c-3759b6289f44 {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  780.315334] env[65478]: WARNING nova.compute.manager [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Received unexpected event network-vif-plugged-e599424e-fe74-4d2c-948c-3759b6289f44 for instance with vm_state active and task_state None.
[  780.315499] env[65478]: DEBUG nova.compute.manager [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Received event network-changed-e599424e-fe74-4d2c-948c-3759b6289f44 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  780.315628] env[65478]: DEBUG nova.compute.manager [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Refreshing instance network info cache due to event network-changed-e599424e-fe74-4d2c-948c-3759b6289f44. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  780.315781] env[65478]: DEBUG oslo_concurrency.lockutils [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] Acquiring lock "refresh_cache-4821048b-4b5a-40b5-8888-f00dd28425d1" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  780.315926] env[65478]: DEBUG oslo_concurrency.lockutils [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] Acquired lock "refresh_cache-4821048b-4b5a-40b5-8888-f00dd28425d1" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  780.315977] env[65478]: DEBUG nova.network.neutron [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Refreshing network info cache for port e599424e-fe74-4d2c-948c-3759b6289f44 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  780.337944] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Task: {'id': task-6011626, 'name': ReconfigVM_Task, 'duration_secs': 0.297614} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  780.338724] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] [instance: 95525483-b7db-427e-87b5-3f946972a250] Reconfigured VM instance instance-00000008 to attach disk [datastore1] 95525483-b7db-427e-87b5-3f946972a250/95525483-b7db-427e-87b5-3f946972a250.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  780.339445] env[65478]: DEBUG oslo_vmware.service [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-68137dea-83b8-4fa5-beec-2dbc3568a3a5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  780.349989] env[65478]: DEBUG oslo_vmware.api [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011627, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.06094} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  780.351634] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Waiting for the task: (returnval){
[  780.351634] env[65478]:    value = "task-6011629"
[  780.351634] env[65478]:    _type = "Task"
[  780.351634] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  780.355930] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  780.356966] env[65478]: DEBUG oslo_vmware.service [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-05f88bf6-f63f-4e55-9361-7bf119021741 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  780.364779] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Task: {'id': task-6011629, 'name': Rename_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  780.386648] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Reconfiguring VM instance instance-00000016 to attach disk [datastore1] 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3/4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  780.387983] env[65478]: DEBUG oslo_vmware.service [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-68d9b69a-7f45-4e7a-9792-92d5887b181f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  780.412556] env[65478]: DEBUG oslo_vmware.api [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Waiting for the task: (returnval){
[  780.412556] env[65478]:    value = "task-6011630"
[  780.412556] env[65478]:    _type = "Task"
[  780.412556] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  780.422611] env[65478]: DEBUG oslo_vmware.api [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011630, 'name': ReconfigVM_Task} progress is 10%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  780.471051] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.631s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  780.471972] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.733s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  780.473869] env[65478]: DEBUG nova.compute.manager [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  780.477165] env[65478]: INFO nova.compute.claims [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  780.628904] env[65478]: WARNING neutronclient.v2_0.client [req-a519318f-c843-4907-98aa-c430b986dd04 req-9b0f662a-ebf8-48b8-b418-afe23824734d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  780.692969] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Acquiring lock "f0e88cef-300d-42a4-9cb6-843dc85da6a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  780.693195] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Lock "f0e88cef-300d-42a4-9cb6-843dc85da6a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  780.716262] env[65478]: DEBUG oslo_vmware.api [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Task: {'id': task-6011628, 'name': CopyVirtualDisk_Task} progress is 77%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  780.769862] env[65478]: DEBUG oslo_vmware.api [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c1d251-905d-fe78-ca68-23241d2a1583, 'name': SearchDatastore_Task, 'duration_secs': 0.014414} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  780.770118] env[65478]: DEBUG oslo_vmware.service [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-83530fce-882a-4ade-9a96-439148ad8b50 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  780.776046] env[65478]: DEBUG oslo_vmware.api [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[  780.776046] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]526cff84-c676-c1c3-1d3e-31f0a92246cc"
[  780.776046] env[65478]:    _type = "Task"
[  780.776046] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  780.785566] env[65478]: DEBUG oslo_vmware.api [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]526cff84-c676-c1c3-1d3e-31f0a92246cc, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  780.818883] env[65478]: WARNING neutronclient.v2_0.client [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  780.862992] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Task: {'id': task-6011629, 'name': Rename_Task, 'duration_secs': 0.22318} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  780.863173] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] [instance: 95525483-b7db-427e-87b5-3f946972a250] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  780.863794] env[65478]: DEBUG oslo_vmware.service [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-66c905e9-d07a-459a-9078-316e209177f5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  780.869933] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Waiting for the task: (returnval){
[  780.869933] env[65478]:    value = "task-6011631"
[  780.869933] env[65478]:    _type = "Task"
[  780.869933] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  780.879467] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Task: {'id': task-6011631, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  780.926484] env[65478]: DEBUG oslo_vmware.api [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011630, 'name': ReconfigVM_Task, 'duration_secs': 0.475539} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  780.926698] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Reconfigured VM instance instance-00000016 to attach disk [datastore1] 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3/4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  780.927743] env[65478]: DEBUG oslo_vmware.service [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-8d936e7a-32dc-44e4-8bea-3ae97817fcee {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  780.935931] env[65478]: DEBUG oslo_vmware.api [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Waiting for the task: (returnval){
[  780.935931] env[65478]:    value = "task-6011632"
[  780.935931] env[65478]:    _type = "Task"
[  780.935931] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  780.942998] env[65478]: DEBUG oslo_vmware.api [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011632, 'name': Rename_Task} progress is 5%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  780.981863] env[65478]: DEBUG nova.compute.utils [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  780.991987] env[65478]: DEBUG nova.compute.manager [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  780.996795] env[65478]: DEBUG nova.network.neutron [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  780.996795] env[65478]: DEBUG nova.network.neutron [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Successfully updated port: 60d749ab-453c-414e-a511-3bb1b9f041d0 {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  781.003441] env[65478]: WARNING neutronclient.v2_0.client [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  781.004154] env[65478]: WARNING neutronclient.v2_0.client [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  781.071157] env[65478]: DEBUG nova.policy [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d88a3cccf2443739e6fe8266c74c0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e9adbd728148138137b916a3d2fc1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  781.111146] env[65478]: WARNING neutronclient.v2_0.client [req-a519318f-c843-4907-98aa-c430b986dd04 req-9b0f662a-ebf8-48b8-b418-afe23824734d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  781.201019] env[65478]: DEBUG nova.compute.manager [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  781.215961] env[65478]: DEBUG oslo_vmware.api [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Task: {'id': task-6011628, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.559241} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  781.216160] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Copied Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] d978e71d-2c30-4a76-b000-6ddf3203ab10/d978e71d-2c30-4a76-b000-6ddf3203ab10.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  781.216301] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  781.216581] env[65478]: DEBUG oslo_vmware.service [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-81d8746a-ef2c-43a2-871e-1a3d722b5c42 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  781.222155] env[65478]: DEBUG oslo_vmware.api [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Waiting for the task: (returnval){
[  781.222155] env[65478]:    value = "task-6011633"
[  781.222155] env[65478]:    _type = "Task"
[  781.222155] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  781.232037] env[65478]: DEBUG oslo_vmware.api [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Task: {'id': task-6011633, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  781.260500] env[65478]: DEBUG nova.network.neutron [req-a519318f-c843-4907-98aa-c430b986dd04 req-9b0f662a-ebf8-48b8-b418-afe23824734d service nova] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Updated VIF entry in instance network info cache for port 2fb52993-7218-432a-bea9-5337867a80b6. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  781.261161] env[65478]: DEBUG nova.network.neutron [req-a519318f-c843-4907-98aa-c430b986dd04 req-9b0f662a-ebf8-48b8-b418-afe23824734d service nova] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Updating instance_info_cache with network_info: [{"id": "2fb52993-7218-432a-bea9-5337867a80b6", "address": "fa:16:3e:d1:9e:61", "network": {"id": "2ed010d6-4573-4056-a189-22d86fca4369", "bridge": "br-int", "label": "tempest-ServersWithSpecificFlavorTestJSON-2103777099-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "10.180.180.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "70efc035843c47d69ec6a42f446a2b91", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "b250e561-3be3-4bae-be1a-162251b1ee31", "external-id": "nsx-vlan-transportzone-464", "segmentation_id": 464, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap2fb52993-72", "ovs_interfaceid": "2fb52993-7218-432a-bea9-5337867a80b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  781.288121] env[65478]: DEBUG oslo_vmware.api [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]526cff84-c676-c1c3-1d3e-31f0a92246cc, 'name': SearchDatastore_Task, 'duration_secs': 0.009773} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  781.288438] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  781.288755] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Copying Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] db37d828-c474-4577-816b-6fb2fcd9a82b/db37d828-c474-4577-816b-6fb2fcd9a82b.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  781.288931] env[65478]: DEBUG oslo_vmware.service [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-e75e8955-17c5-4aa6-8c39-96bd48b8ba5d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  781.296551] env[65478]: DEBUG oslo_vmware.api [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[  781.296551] env[65478]:    value = "task-6011634"
[  781.296551] env[65478]:    _type = "Task"
[  781.296551] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  781.306310] env[65478]: DEBUG oslo_vmware.api [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011634, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  781.380768] env[65478]: DEBUG oslo_vmware.api [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Task: {'id': task-6011631, 'name': PowerOnVM_Task, 'duration_secs': 0.46497} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  781.380988] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] [instance: 95525483-b7db-427e-87b5-3f946972a250] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  781.381186] env[65478]: DEBUG nova.compute.manager [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] [instance: 95525483-b7db-427e-87b5-3f946972a250] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  781.382071] env[65478]: DEBUG oslo_vmware.service [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-73a07a8f-d655-40fd-9161-0ca07c9368b0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  781.397401] env[65478]: WARNING neutronclient.v2_0.client [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  781.443895] env[65478]: DEBUG oslo_vmware.api [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011632, 'name': Rename_Task, 'duration_secs': 0.148266} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  781.444282] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  781.444691] env[65478]: DEBUG oslo_vmware.service [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-06ccd687-c191-4a7e-ad80-c046432f901f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  781.455096] env[65478]: DEBUG oslo_vmware.api [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Waiting for the task: (returnval){
[  781.455096] env[65478]:    value = "task-6011635"
[  781.455096] env[65478]:    _type = "Task"
[  781.455096] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  781.461086] env[65478]: DEBUG nova.network.neutron [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Successfully created port: 69013773-3f93-4432-9c5b-6726964a77d9 {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  781.468127] env[65478]: DEBUG oslo_vmware.api [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011635, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  781.506347] env[65478]: DEBUG nova.network.neutron [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Updated VIF entry in instance network info cache for port e599424e-fe74-4d2c-948c-3759b6289f44. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  781.506659] env[65478]: DEBUG nova.network.neutron [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Updating instance_info_cache with network_info: [{"id": "e599424e-fe74-4d2c-948c-3759b6289f44", "address": "fa:16:3e:c1:84:26", "network": {"id": "386793de-d2e2-4c26-8cab-60dbf2a2ffe3", "bridge": "br-int", "label": "tempest-InstanceActionsTestJSON-2039284656-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "60c31211e0004fe78fab62e554754271", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "50886eea-591a-452c-a27b-5f22cfc9df85", "external-id": "nsx-vlan-transportzone-578", "segmentation_id": 578, "bound_drivers": {"0": "nsxv3"}}, "devname": "tape599424e-fe", "ovs_interfaceid": "e599424e-fe74-4d2c-948c-3759b6289f44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  781.517317] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Acquiring lock "refresh_cache-6ef7bbde-0ba8-44a9-8643-e674a14f3cbc" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  781.517317] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Acquired lock "refresh_cache-6ef7bbde-0ba8-44a9-8643-e674a14f3cbc" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  781.517523] env[65478]: DEBUG nova.network.neutron [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  781.524870] env[65478]: DEBUG nova.compute.manager [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  781.736972] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  781.742996] env[65478]: DEBUG oslo_vmware.api [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Task: {'id': task-6011633, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.063775} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  781.742996] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  781.747216] env[65478]: DEBUG oslo_vmware.service [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-24298a70-b922-435e-9f26-54a190e31980 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  781.765324] env[65478]: DEBUG oslo_concurrency.lockutils [req-a519318f-c843-4907-98aa-c430b986dd04 req-9b0f662a-ebf8-48b8-b418-afe23824734d service nova] Releasing lock "refresh_cache-4f7fb80a-cb05-4bd5-bb10-380d95b2e892" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  781.780528] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Reconfiguring VM instance instance-00000014 to attach disk [datastore1] d978e71d-2c30-4a76-b000-6ddf3203ab10/d978e71d-2c30-4a76-b000-6ddf3203ab10.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  781.781325] env[65478]: DEBUG oslo_vmware.service [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-737ca76f-1c02-4dc0-be85-4a8ee23855c4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  781.818374] env[65478]: DEBUG oslo_vmware.api [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011634, 'name': CopyVirtualDisk_Task} progress is 77%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  781.820236] env[65478]: DEBUG oslo_vmware.api [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Waiting for the task: (returnval){
[  781.820236] env[65478]:    value = "task-6011636"
[  781.820236] env[65478]:    _type = "Task"
[  781.820236] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  781.828604] env[65478]: DEBUG oslo_vmware.api [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Task: {'id': task-6011636, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  781.903718] env[65478]: DEBUG oslo_concurrency.lockutils [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  781.926589] env[65478]: DEBUG oslo_vmware.service [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f5c4c75b-831a-4061-9c34-b5cdf080d325 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  781.935522] env[65478]: DEBUG oslo_vmware.service [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-11644d0e-874c-4288-84cf-4fdcde42bc51 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  781.971924] env[65478]: DEBUG oslo_vmware.service [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6bfe4c07-1b34-437d-838a-255bcb17f840 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  781.980299] env[65478]: DEBUG oslo_vmware.api [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011635, 'name': PowerOnVM_Task} progress is 1%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  781.983657] env[65478]: DEBUG oslo_vmware.service [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c5bc47a2-8873-41db-ac0f-7777b8bf21f9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  781.998168] env[65478]: DEBUG nova.compute.provider_tree [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  781.999335] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Acquiring lock "f01c577a-3995-465a-98ae-21880df54cc0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  781.999697] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Lock "f01c577a-3995-465a-98ae-21880df54cc0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  782.000126] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Acquiring lock "f01c577a-3995-465a-98ae-21880df54cc0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  782.000665] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Lock "f01c577a-3995-465a-98ae-21880df54cc0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  782.000833] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Lock "f01c577a-3995-465a-98ae-21880df54cc0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  782.003904] env[65478]: INFO nova.compute.manager [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Terminating instance
[  782.012114] env[65478]: DEBUG oslo_concurrency.lockutils [req-f50f86fa-32ca-4f9b-ab1a-314e155149e3 req-bb59a186-0b0e-45f7-b841-c21d7d04f679 service nova] Releasing lock "refresh_cache-4821048b-4b5a-40b5-8888-f00dd28425d1" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  782.106694] env[65478]: DEBUG nova.network.neutron [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  782.299297] env[65478]: WARNING neutronclient.v2_0.client [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  782.311896] env[65478]: DEBUG oslo_vmware.api [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011634, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.550032} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  782.312113] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Copied Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] db37d828-c474-4577-816b-6fb2fcd9a82b/db37d828-c474-4577-816b-6fb2fcd9a82b.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  782.312297] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  782.312532] env[65478]: DEBUG oslo_vmware.service [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-c3f259e7-dd7f-4af4-a18e-01ecb40cc041 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  782.318519] env[65478]: DEBUG oslo_vmware.api [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[  782.318519] env[65478]:    value = "task-6011637"
[  782.318519] env[65478]:    _type = "Task"
[  782.318519] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  782.333259] env[65478]: DEBUG oslo_vmware.api [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Task: {'id': task-6011636, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  782.336671] env[65478]: DEBUG oslo_vmware.api [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011637, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  782.469667] env[65478]: DEBUG oslo_vmware.api [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011635, 'name': PowerOnVM_Task} progress is 64%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  782.510668] env[65478]: DEBUG nova.compute.manager [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[  782.511727] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  782.512815] env[65478]: DEBUG oslo_vmware.service [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8d3fe323-546e-4d30-a7f1-2a036816e72d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  782.516072] env[65478]: DEBUG nova.network.neutron [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Updating instance_info_cache with network_info: [{"id": "60d749ab-453c-414e-a511-3bb1b9f041d0", "address": "fa:16:3e:1c:b9:33", "network": {"id": "cf40b8d0-87c8-445d-9b09-7d7b98212c02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1605028920-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8de0dd2b26b24b4fb6e13f475974035a", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "423047aa-c430-4593-a76c-9982c15c81cf", "external-id": "nsx-vlan-transportzone-262", "segmentation_id": 262, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap60d749ab-45", "ovs_interfaceid": "60d749ab-453c-414e-a511-3bb1b9f041d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  782.522478] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  782.522750] env[65478]: DEBUG oslo_vmware.service [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-c53740cb-d48e-4015-8f0a-cd436e486feb {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  782.525783] env[65478]: ERROR nova.scheduler.client.report [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [req-d672fe69-a06d-4805-8076-eef518578445] Failed to update inventory to [{'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}}] for resource provider with UUID e3a5020e-0218-494b-ae38-8b55aa77f6f5.  Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n resource provider generation conflict  ", "code": "placement.concurrent_update", "request_id": "req-d672fe69-a06d-4805-8076-eef518578445"}]}
[  782.530068] env[65478]: DEBUG oslo_vmware.api [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Waiting for the task: (returnval){
[  782.530068] env[65478]:    value = "task-6011638"
[  782.530068] env[65478]:    _type = "Task"
[  782.530068] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  782.538363] env[65478]: DEBUG nova.compute.manager [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  782.544041] env[65478]: DEBUG oslo_vmware.api [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Task: {'id': task-6011638, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  782.551837] env[65478]: DEBUG nova.scheduler.client.report [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Refreshing inventories for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
[  782.570772] env[65478]: DEBUG nova.virt.hardware [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  782.570960] env[65478]: DEBUG nova.virt.hardware [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  782.571090] env[65478]: DEBUG nova.virt.hardware [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  782.571677] env[65478]: DEBUG nova.virt.hardware [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  782.571790] env[65478]: DEBUG nova.virt.hardware [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  782.571897] env[65478]: DEBUG nova.virt.hardware [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  782.572089] env[65478]: DEBUG nova.virt.hardware [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  782.572210] env[65478]: DEBUG nova.virt.hardware [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  782.572395] env[65478]: DEBUG nova.virt.hardware [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  782.572501] env[65478]: DEBUG nova.virt.hardware [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  782.572641] env[65478]: DEBUG nova.virt.hardware [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  782.573734] env[65478]: DEBUG oslo_vmware.service [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-916cc4c9-2853-4683-83b4-91ff56ec34ed {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  782.579055] env[65478]: DEBUG nova.scheduler.client.report [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Updating ProviderTree inventory for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
[  782.579385] env[65478]: DEBUG nova.compute.provider_tree [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  782.586467] env[65478]: DEBUG oslo_vmware.service [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-709bf366-518c-4e0b-91a0-69ba04543014 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  782.605688] env[65478]: DEBUG nova.scheduler.client.report [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Refreshing aggregate associations for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5, aggregates: None {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
[  782.613511] env[65478]: DEBUG nova.compute.manager [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Received event network-vif-plugged-a4636485-7b6f-4fbb-ab94-d4f75ada7a1c {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  782.613787] env[65478]: DEBUG oslo_concurrency.lockutils [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] Acquiring lock "d978e71d-2c30-4a76-b000-6ddf3203ab10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  782.613963] env[65478]: DEBUG oslo_concurrency.lockutils [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] Lock "d978e71d-2c30-4a76-b000-6ddf3203ab10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  782.614129] env[65478]: DEBUG oslo_concurrency.lockutils [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] Lock "d978e71d-2c30-4a76-b000-6ddf3203ab10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  782.614269] env[65478]: DEBUG nova.compute.manager [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] No waiting events found dispatching network-vif-plugged-a4636485-7b6f-4fbb-ab94-d4f75ada7a1c {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  782.614394] env[65478]: WARNING nova.compute.manager [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Received unexpected event network-vif-plugged-a4636485-7b6f-4fbb-ab94-d4f75ada7a1c for instance with vm_state building and task_state spawning.
[  782.614550] env[65478]: DEBUG nova.compute.manager [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Received event network-changed-a4636485-7b6f-4fbb-ab94-d4f75ada7a1c {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  782.614948] env[65478]: DEBUG nova.compute.manager [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Refreshing instance network info cache due to event network-changed-a4636485-7b6f-4fbb-ab94-d4f75ada7a1c. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  782.614948] env[65478]: DEBUG oslo_concurrency.lockutils [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] Acquiring lock "refresh_cache-d978e71d-2c30-4a76-b000-6ddf3203ab10" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  782.614948] env[65478]: DEBUG oslo_concurrency.lockutils [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] Acquired lock "refresh_cache-d978e71d-2c30-4a76-b000-6ddf3203ab10" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  782.615374] env[65478]: DEBUG nova.network.neutron [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Refreshing network info cache for port a4636485-7b6f-4fbb-ab94-d4f75ada7a1c {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  782.638044] env[65478]: DEBUG nova.scheduler.client.report [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Refreshing trait associations for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_VMDK,COMPUTE_IMAGE_TYPE_ISO,HW_ARCH_X86_64,COMPUTE_SAME_HOST_COLD_MIGRATE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
[  782.831875] env[65478]: DEBUG oslo_vmware.api [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011637, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.063403} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  782.833371] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  782.837785] env[65478]: DEBUG oslo_vmware.service [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c2b33595-7c18-4673-b444-4dcff865398b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  782.840360] env[65478]: DEBUG oslo_vmware.api [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Task: {'id': task-6011636, 'name': ReconfigVM_Task, 'duration_secs': 0.701717} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  782.841938] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Reconfigured VM instance instance-00000014 to attach disk [datastore1] d978e71d-2c30-4a76-b000-6ddf3203ab10/d978e71d-2c30-4a76-b000-6ddf3203ab10.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  782.846277] env[65478]: DEBUG oslo_vmware.service [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-bfb202b2-82d9-4108-8777-afa86f7601b1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  782.869580] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Reconfiguring VM instance instance-00000015 to attach disk [datastore1] db37d828-c474-4577-816b-6fb2fcd9a82b/db37d828-c474-4577-816b-6fb2fcd9a82b.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  782.869915] env[65478]: DEBUG oslo_vmware.service [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-d0069cf9-875e-4133-9520-8968e8936fc7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  782.885991] env[65478]: DEBUG oslo_vmware.api [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Waiting for the task: (returnval){
[  782.885991] env[65478]:    value = "task-6011639"
[  782.885991] env[65478]:    _type = "Task"
[  782.885991] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  782.899240] env[65478]: DEBUG oslo_vmware.api [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[  782.899240] env[65478]:    value = "task-6011640"
[  782.899240] env[65478]:    _type = "Task"
[  782.899240] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  782.908451] env[65478]: DEBUG oslo_vmware.api [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Task: {'id': task-6011639, 'name': Rename_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  782.912895] env[65478]: DEBUG oslo_vmware.api [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011640, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  782.972769] env[65478]: DEBUG oslo_vmware.api [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011635, 'name': PowerOnVM_Task} progress is 73%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  783.018634] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Releasing lock "refresh_cache-6ef7bbde-0ba8-44a9-8643-e674a14f3cbc" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  783.018935] env[65478]: DEBUG nova.compute.manager [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Instance network_info: |[{"id": "60d749ab-453c-414e-a511-3bb1b9f041d0", "address": "fa:16:3e:1c:b9:33", "network": {"id": "cf40b8d0-87c8-445d-9b09-7d7b98212c02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1605028920-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8de0dd2b26b24b4fb6e13f475974035a", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "423047aa-c430-4593-a76c-9982c15c81cf", "external-id": "nsx-vlan-transportzone-262", "segmentation_id": 262, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap60d749ab-45", "ovs_interfaceid": "60d749ab-453c-414e-a511-3bb1b9f041d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  783.021974] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:1c:b9:33', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': '423047aa-c430-4593-a76c-9982c15c81cf', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': '60d749ab-453c-414e-a511-3bb1b9f041d0', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  783.031575] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Creating folder: Project (8de0dd2b26b24b4fb6e13f475974035a). Parent ref: group-v1161186. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  783.041104] env[65478]: DEBUG oslo_vmware.service [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-7ec918cc-df92-4de8-91ef-ce6aec5bb075 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  783.046715] env[65478]: DEBUG oslo_vmware.api [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Task: {'id': task-6011638, 'name': PowerOffVM_Task, 'duration_secs': 0.215585} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  783.047130] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  783.047553] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  783.048046] env[65478]: DEBUG oslo_vmware.service [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-02390296-58fa-4515-a228-73ccba143127 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  783.052410] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Created folder: Project (8de0dd2b26b24b4fb6e13f475974035a) in parent group-v1161186.
[  783.052558] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Creating folder: Instances. Parent ref: group-v1161251. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  783.052784] env[65478]: DEBUG oslo_vmware.service [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-93461426-2780-41a2-a2a0-814e7169e129 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  783.059253] env[65478]: DEBUG oslo_vmware.service [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-5a443c15-234d-4f2c-a60f-59a089f11547 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  783.066468] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Created folder: Instances in parent group-v1161251.
[  783.067692] env[65478]: DEBUG oslo_vmware.service [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-999141b6-5e63-49f1-852a-28bdce2ca9c8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  783.072722] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  783.074382] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  783.075780] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-5a6573d7-1c98-49a5-85fb-4eeebc053843 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  783.120157] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  783.142689] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Deleting contents of the VM from datastore datastore2 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  783.144575] env[65478]: DEBUG oslo_vmware.service [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-858b3f1b-35e0-4850-b7b6-e187225df3f7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  783.148707] env[65478]: WARNING neutronclient.v2_0.client [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  783.151538] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Deleting the datastore file [datastore2] f01c577a-3995-465a-98ae-21880df54cc0 {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  783.152175] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  783.152175] env[65478]:    value = "task-6011644"
[  783.152175] env[65478]:    _type = "Task"
[  783.152175] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  783.155236] env[65478]: DEBUG nova.network.neutron [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Successfully updated port: 69013773-3f93-4432-9c5b-6726964a77d9 {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  783.157375] env[65478]: DEBUG oslo_vmware.service [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-ab257d82-5bfa-4f30-a79d-913c9d3c1639 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  783.165536] env[65478]: DEBUG oslo_vmware.service [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-28b5b822-709d-4eec-bbce-39e68c73dfeb {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  783.175093] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011644, 'name': CreateVM_Task} progress is 15%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  783.188491] env[65478]: DEBUG nova.compute.provider_tree [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  783.190710] env[65478]: DEBUG oslo_vmware.api [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Waiting for the task: (returnval){
[  783.190710] env[65478]:    value = "task-6011645"
[  783.190710] env[65478]:    _type = "Task"
[  783.190710] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  783.201355] env[65478]: DEBUG oslo_vmware.api [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Task: {'id': task-6011645, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  783.302657] env[65478]: DEBUG oslo_concurrency.lockutils [None req-3b40bd7d-b500-4ca0-a2b8-64a64345af4b tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Acquiring lock "4821048b-4b5a-40b5-8888-f00dd28425d1" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  783.302885] env[65478]: DEBUG oslo_concurrency.lockutils [None req-3b40bd7d-b500-4ca0-a2b8-64a64345af4b tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Lock "4821048b-4b5a-40b5-8888-f00dd28425d1" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  783.303135] env[65478]: INFO nova.compute.manager [None req-3b40bd7d-b500-4ca0-a2b8-64a64345af4b tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Rebooting instance
[  783.361969] env[65478]: WARNING neutronclient.v2_0.client [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  783.402509] env[65478]: DEBUG oslo_vmware.api [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Task: {'id': task-6011639, 'name': Rename_Task, 'duration_secs': 0.145417} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  783.406883] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  783.409643] env[65478]: DEBUG oslo_vmware.service [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-a3ec3f15-ee90-4855-8fbd-4b9426161a42 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  783.415329] env[65478]: DEBUG oslo_vmware.api [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011640, 'name': ReconfigVM_Task, 'duration_secs': 0.484112} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  783.415787] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Reconfigured VM instance instance-00000015 to attach disk [datastore1] db37d828-c474-4577-816b-6fb2fcd9a82b/db37d828-c474-4577-816b-6fb2fcd9a82b.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  783.416643] env[65478]: DEBUG oslo_vmware.service [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-5f32a242-e4c0-4609-93e6-d07d5a3244a0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  783.423288] env[65478]: DEBUG oslo_vmware.api [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[  783.423288] env[65478]:    value = "task-6011646"
[  783.423288] env[65478]:    _type = "Task"
[  783.423288] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  783.429413] env[65478]: DEBUG oslo_vmware.api [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Waiting for the task: (returnval){
[  783.429413] env[65478]:    value = "task-6011647"
[  783.429413] env[65478]:    _type = "Task"
[  783.429413] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  783.436305] env[65478]: DEBUG oslo_vmware.api [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011646, 'name': Rename_Task} progress is 5%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  783.445582] env[65478]: DEBUG oslo_vmware.api [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Task: {'id': task-6011647, 'name': PowerOnVM_Task} progress is 33%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  783.468156] env[65478]: DEBUG nova.network.neutron [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Updated VIF entry in instance network info cache for port a4636485-7b6f-4fbb-ab94-d4f75ada7a1c. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  783.468156] env[65478]: DEBUG nova.network.neutron [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Updating instance_info_cache with network_info: [{"id": "a4636485-7b6f-4fbb-ab94-d4f75ada7a1c", "address": "fa:16:3e:bc:0f:ab", "network": {"id": "432219d2-eada-4b7b-82da-1951de930922", "bridge": "br-int", "label": "tempest-AttachInterfacesUnderV243Test-1661348426-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "1f872aa3128c4866aed16d152b15486f", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "8b1a0b17-d008-4a8b-be2a-796ff1a9a2d1", "external-id": "nsx-vlan-transportzone-880", "segmentation_id": 880, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapa4636485-7b", "ovs_interfaceid": "a4636485-7b6f-4fbb-ab94-d4f75ada7a1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  783.474121] env[65478]: DEBUG oslo_vmware.api [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011635, 'name': PowerOnVM_Task, 'duration_secs': 1.71902} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  783.474418] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  783.474616] env[65478]: INFO nova.compute.manager [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Took 6.05 seconds to spawn the instance on the hypervisor.
[  783.474764] env[65478]: DEBUG nova.compute.manager [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  783.475731] env[65478]: DEBUG oslo_vmware.service [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0a2cd4d3-5506-4b96-8f1d-499d0a7239de {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  783.666765] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011644, 'name': CreateVM_Task, 'duration_secs': 0.485215} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  783.666921] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  783.670610] env[65478]: WARNING neutronclient.v2_0.client [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  783.670610] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  783.670610] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  783.670610] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Acquired external semaphore "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  783.670610] env[65478]: DEBUG oslo_vmware.service [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-10f85af0-15c1-401e-8cef-343e5b1d7f9a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  783.676455] env[65478]: DEBUG oslo_vmware.api [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for the task: (returnval){
[  783.676455] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52eddd3f-fd69-3922-d73d-2368b5e8032b"
[  783.676455] env[65478]:    _type = "Task"
[  783.676455] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  783.682021] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Acquiring lock "refresh_cache-b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  783.685266] env[65478]: DEBUG oslo_vmware.api [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52eddd3f-fd69-3922-d73d-2368b5e8032b, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  783.686193] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Acquired lock "refresh_cache-b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  783.686365] env[65478]: DEBUG nova.network.neutron [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  783.701782] env[65478]: DEBUG oslo_vmware.api [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Task: {'id': task-6011645, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.152587} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  783.702044] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  783.702111] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Deleted contents of the VM from datastore datastore2 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  783.702646] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  783.703107] env[65478]: INFO nova.compute.manager [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Took 1.19 seconds to destroy the instance on the hypervisor.
[  783.704046] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  783.706125] env[65478]: DEBUG nova.compute.manager [-] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[  783.706443] env[65478]: DEBUG nova.network.neutron [-] [instance: f01c577a-3995-465a-98ae-21880df54cc0] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[  783.706807] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  783.742846] env[65478]: DEBUG nova.scheduler.client.report [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Updated inventory for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with generation 32 in Placement from set_inventory_for_provider using data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}}
[  783.743098] env[65478]: DEBUG nova.compute.provider_tree [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Updating resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 generation from 32 to 33 during operation: update_inventory {{(pid=65478) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
[  783.743191] env[65478]: DEBUG nova.compute.provider_tree [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  783.748065] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  783.859265] env[65478]: DEBUG oslo_concurrency.lockutils [None req-3b40bd7d-b500-4ca0-a2b8-64a64345af4b tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Acquiring lock "refresh_cache-4821048b-4b5a-40b5-8888-f00dd28425d1" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  783.859265] env[65478]: DEBUG oslo_concurrency.lockutils [None req-3b40bd7d-b500-4ca0-a2b8-64a64345af4b tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Acquired lock "refresh_cache-4821048b-4b5a-40b5-8888-f00dd28425d1" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  783.859265] env[65478]: DEBUG nova.network.neutron [None req-3b40bd7d-b500-4ca0-a2b8-64a64345af4b tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  783.938571] env[65478]: DEBUG oslo_vmware.api [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011646, 'name': Rename_Task, 'duration_secs': 0.234205} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  783.939243] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  783.940968] env[65478]: DEBUG oslo_vmware.service [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-2caa9f36-af29-476e-8981-49b5e6180711 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  783.946866] env[65478]: DEBUG oslo_vmware.api [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Task: {'id': task-6011647, 'name': PowerOnVM_Task} progress is 88%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  783.951528] env[65478]: DEBUG oslo_vmware.api [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[  783.951528] env[65478]:    value = "task-6011648"
[  783.951528] env[65478]:    _type = "Task"
[  783.951528] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  783.960924] env[65478]: DEBUG oslo_vmware.api [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011648, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  783.970449] env[65478]: DEBUG oslo_concurrency.lockutils [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] Releasing lock "refresh_cache-d978e71d-2c30-4a76-b000-6ddf3203ab10" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  783.970679] env[65478]: DEBUG nova.compute.manager [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Received event network-vif-plugged-321b5f6a-6eb5-4a41-86a9-3eac3f4def7b {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  783.970779] env[65478]: DEBUG oslo_concurrency.lockutils [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] Acquiring lock "db37d828-c474-4577-816b-6fb2fcd9a82b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  783.970937] env[65478]: DEBUG oslo_concurrency.lockutils [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] Lock "db37d828-c474-4577-816b-6fb2fcd9a82b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  783.971108] env[65478]: DEBUG oslo_concurrency.lockutils [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] Lock "db37d828-c474-4577-816b-6fb2fcd9a82b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  783.971275] env[65478]: DEBUG nova.compute.manager [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] No waiting events found dispatching network-vif-plugged-321b5f6a-6eb5-4a41-86a9-3eac3f4def7b {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  783.971555] env[65478]: WARNING nova.compute.manager [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Received unexpected event network-vif-plugged-321b5f6a-6eb5-4a41-86a9-3eac3f4def7b for instance with vm_state building and task_state spawning.
[  783.971694] env[65478]: DEBUG nova.compute.manager [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Received event network-changed-321b5f6a-6eb5-4a41-86a9-3eac3f4def7b {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  783.971865] env[65478]: DEBUG nova.compute.manager [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Refreshing instance network info cache due to event network-changed-321b5f6a-6eb5-4a41-86a9-3eac3f4def7b. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  783.972227] env[65478]: DEBUG oslo_concurrency.lockutils [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] Acquiring lock "refresh_cache-db37d828-c474-4577-816b-6fb2fcd9a82b" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  783.972227] env[65478]: DEBUG oslo_concurrency.lockutils [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] Acquired lock "refresh_cache-db37d828-c474-4577-816b-6fb2fcd9a82b" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  783.972406] env[65478]: DEBUG nova.network.neutron [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Refreshing network info cache for port 321b5f6a-6eb5-4a41-86a9-3eac3f4def7b {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  783.998194] env[65478]: INFO nova.compute.manager [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Took 13.56 seconds to build instance.
[  784.116360] env[65478]: DEBUG nova.compute.manager [req-0b2a8a81-af4c-4e25-923b-8ebba1fe9c7f req-ccc56c83-bde5-4b92-b154-a12d89699c34 service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Received event network-changed-457c1734-c99a-4d71-a200-0341a9e3bdd8 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  784.117742] env[65478]: DEBUG nova.compute.manager [req-0b2a8a81-af4c-4e25-923b-8ebba1fe9c7f req-ccc56c83-bde5-4b92-b154-a12d89699c34 service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Refreshing instance network info cache due to event network-changed-457c1734-c99a-4d71-a200-0341a9e3bdd8. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  784.117935] env[65478]: DEBUG oslo_concurrency.lockutils [req-0b2a8a81-af4c-4e25-923b-8ebba1fe9c7f req-ccc56c83-bde5-4b92-b154-a12d89699c34 service nova] Acquiring lock "refresh_cache-caf7856c-4e51-4e6c-ad32-2088e15d5d8f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  784.118052] env[65478]: DEBUG oslo_concurrency.lockutils [req-0b2a8a81-af4c-4e25-923b-8ebba1fe9c7f req-ccc56c83-bde5-4b92-b154-a12d89699c34 service nova] Acquired lock "refresh_cache-caf7856c-4e51-4e6c-ad32-2088e15d5d8f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  784.118177] env[65478]: DEBUG nova.network.neutron [req-0b2a8a81-af4c-4e25-923b-8ebba1fe9c7f req-ccc56c83-bde5-4b92-b154-a12d89699c34 service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Refreshing network info cache for port 457c1734-c99a-4d71-a200-0341a9e3bdd8 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  784.188369] env[65478]: DEBUG oslo_vmware.api [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52eddd3f-fd69-3922-d73d-2368b5e8032b, 'name': SearchDatastore_Task, 'duration_secs': 0.009274} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  784.189239] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  784.189239] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  784.191809] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  784.192130] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  784.193096] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Creating directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  784.193096] env[65478]: DEBUG oslo_vmware.service [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-dcc1af88-48f0-4c5b-8d59-37c059038280 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  784.202093] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Created directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  784.203030] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Folder [datastore1] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  784.203560] env[65478]: DEBUG oslo_vmware.service [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-3076da09-78cc-4b1a-b1d8-cff9eceea2c4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  784.210643] env[65478]: DEBUG oslo_vmware.api [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for the task: (returnval){
[  784.210643] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52d23252-15f3-7fad-b496-6a1b2b565e12"
[  784.210643] env[65478]:    _type = "Task"
[  784.210643] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  784.219150] env[65478]: DEBUG oslo_vmware.api [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52d23252-15f3-7fad-b496-6a1b2b565e12, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  784.252306] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.781s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  784.253757] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 5.424s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  784.255082] env[65478]: DEBUG nova.compute.manager [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  784.259243] env[65478]: DEBUG nova.objects.instance [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Lazy-loading 'resources' on Instance uuid 6a23cbd2-7031-484c-809e-436397029c7d {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  784.287731] env[65478]: DEBUG nova.network.neutron [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  784.362970] env[65478]: WARNING neutronclient.v2_0.client [None req-3b40bd7d-b500-4ca0-a2b8-64a64345af4b tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  784.444872] env[65478]: DEBUG oslo_vmware.api [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Task: {'id': task-6011647, 'name': PowerOnVM_Task, 'duration_secs': 0.635476} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  784.445054] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  784.445608] env[65478]: INFO nova.compute.manager [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Took 12.02 seconds to spawn the instance on the hypervisor.
[  784.445832] env[65478]: DEBUG nova.compute.manager [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  784.447099] env[65478]: DEBUG oslo_vmware.service [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a7a54b1c-89d9-44a4-8fb5-b6400adf25b9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  784.453727] env[65478]: WARNING neutronclient.v2_0.client [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  784.471145] env[65478]: DEBUG oslo_vmware.api [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011648, 'name': PowerOnVM_Task} progress is 88%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  784.476371] env[65478]: WARNING neutronclient.v2_0.client [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  784.500533] env[65478]: DEBUG oslo_concurrency.lockutils [None req-40b38095-bef5-40f1-aff0-bf085f9d7b44 tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Lock "4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.090s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  784.536353] env[65478]: DEBUG nova.network.neutron [-] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  784.620703] env[65478]: WARNING neutronclient.v2_0.client [req-0b2a8a81-af4c-4e25-923b-8ebba1fe9c7f req-ccc56c83-bde5-4b92-b154-a12d89699c34 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  784.726536] env[65478]: DEBUG oslo_vmware.api [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52d23252-15f3-7fad-b496-6a1b2b565e12, 'name': SearchDatastore_Task, 'duration_secs': 0.008512} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  784.728460] env[65478]: DEBUG oslo_vmware.service [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-929c378d-43a6-483c-b73d-8d2e1c87e559 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  784.736014] env[65478]: DEBUG oslo_vmware.api [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for the task: (returnval){
[  784.736014] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52237035-ec77-aeb0-0b54-44944f5a446e"
[  784.736014] env[65478]:    _type = "Task"
[  784.736014] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  784.750602] env[65478]: DEBUG oslo_vmware.api [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52237035-ec77-aeb0-0b54-44944f5a446e, 'name': SearchDatastore_Task, 'duration_secs': 0.009259} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  784.750602] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  784.750602] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Copying Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc/6ef7bbde-0ba8-44a9-8643-e674a14f3cbc.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  784.751114] env[65478]: DEBUG oslo_vmware.service [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-3a8d9854-8a6e-4f9a-90f6-abd7a539173d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  784.760090] env[65478]: DEBUG oslo_vmware.api [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for the task: (returnval){
[  784.760090] env[65478]:    value = "task-6011649"
[  784.760090] env[65478]:    _type = "Task"
[  784.760090] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  784.771316] env[65478]: DEBUG nova.compute.utils [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  784.773066] env[65478]: DEBUG nova.compute.manager [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  784.773444] env[65478]: DEBUG nova.network.neutron [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  784.777030] env[65478]: WARNING neutronclient.v2_0.client [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  784.777030] env[65478]: WARNING neutronclient.v2_0.client [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  784.785364] env[65478]: DEBUG oslo_vmware.api [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011649, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  784.904200] env[65478]: DEBUG nova.network.neutron [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Updating instance_info_cache with network_info: [{"id": "69013773-3f93-4432-9c5b-6726964a77d9", "address": "fa:16:3e:b3:d3:36", "network": {"id": "66759086-f176-42e2-b3ef-a01d75ebc07f", "bridge": "br-int", "label": "tempest-InstanceActionsV221TestJSON-1441812429-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "48e9adbd728148138137b916a3d2fc1d", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "310b8ba9-edca-4135-863e-f4a786dd4a77", "external-id": "nsx-vlan-transportzone-768", "segmentation_id": 768, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap69013773-3f", "ovs_interfaceid": "69013773-3f93-4432-9c5b-6726964a77d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  784.967048] env[65478]: DEBUG nova.policy [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e90fae5080e0457a9557b6974756034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a09b6e5ab3418e871f2d26fcd10a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  784.972682] env[65478]: DEBUG oslo_vmware.api [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011648, 'name': PowerOnVM_Task, 'duration_secs': 0.831635} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  784.978275] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  784.979223] env[65478]: INFO nova.compute.manager [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Took 10.06 seconds to spawn the instance on the hypervisor.
[  784.979223] env[65478]: DEBUG nova.compute.manager [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  784.985780] env[65478]: DEBUG oslo_vmware.service [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3fb67ce2-28cb-40a3-8d9e-6578268d7bc5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  784.997913] env[65478]: INFO nova.compute.manager [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Took 17.19 seconds to build instance.
[  785.039103] env[65478]: INFO nova.compute.manager [-] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Took 1.33 seconds to deallocate network for instance.
[  785.162921] env[65478]: WARNING neutronclient.v2_0.client [None req-3b40bd7d-b500-4ca0-a2b8-64a64345af4b tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  785.251621] env[65478]: DEBUG oslo_vmware.service [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-edbacad2-cbec-41d0-b71c-96abe9f006f0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  785.265193] env[65478]: DEBUG oslo_vmware.service [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-95786dcc-a5a5-46f0-8308-2d374a6d40c0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  785.293859] env[65478]: DEBUG nova.compute.manager [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  785.333894] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Acquiring lock "95525483-b7db-427e-87b5-3f946972a250" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  785.333894] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Lock "95525483-b7db-427e-87b5-3f946972a250" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  785.334462] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Acquiring lock "95525483-b7db-427e-87b5-3f946972a250-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  785.334788] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Lock "95525483-b7db-427e-87b5-3f946972a250-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  785.335087] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Lock "95525483-b7db-427e-87b5-3f946972a250-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  785.342673] env[65478]: DEBUG oslo_vmware.api [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011649, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.512961} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  785.345072] env[65478]: DEBUG oslo_vmware.service [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8ef6be33-6ea9-453d-9d49-ccc1aae11db8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  785.349728] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Copied Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc/6ef7bbde-0ba8-44a9-8643-e674a14f3cbc.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  785.359315] env[65478]: INFO nova.compute.manager [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Terminating instance
[  785.360582] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  785.361319] env[65478]: DEBUG oslo_vmware.service [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b0f89eb3-e80a-4a4d-9dd2-49d107af6290 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  785.367862] env[65478]: DEBUG oslo_vmware.service [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-37ffb325-af76-49cd-bb4a-a94cb4542f18 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  785.379497] env[65478]: DEBUG oslo_vmware.api [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for the task: (returnval){
[  785.379497] env[65478]:    value = "task-6011650"
[  785.379497] env[65478]:    _type = "Task"
[  785.379497] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  785.394551] env[65478]: DEBUG nova.compute.provider_tree [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  785.400326] env[65478]: DEBUG oslo_vmware.api [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011650, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  785.408266] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Releasing lock "refresh_cache-b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  785.408266] env[65478]: DEBUG nova.compute.manager [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Instance network_info: |[{"id": "69013773-3f93-4432-9c5b-6726964a77d9", "address": "fa:16:3e:b3:d3:36", "network": {"id": "66759086-f176-42e2-b3ef-a01d75ebc07f", "bridge": "br-int", "label": "tempest-InstanceActionsV221TestJSON-1441812429-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "48e9adbd728148138137b916a3d2fc1d", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "310b8ba9-edca-4135-863e-f4a786dd4a77", "external-id": "nsx-vlan-transportzone-768", "segmentation_id": 768, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap69013773-3f", "ovs_interfaceid": "69013773-3f93-4432-9c5b-6726964a77d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  785.410871] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:b3:d3:36', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': '310b8ba9-edca-4135-863e-f4a786dd4a77', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': '69013773-3f93-4432-9c5b-6726964a77d9', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  785.421557] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Creating folder: Project (48e9adbd728148138137b916a3d2fc1d). Parent ref: group-v1161186. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  785.422479] env[65478]: DEBUG oslo_vmware.service [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-853da6be-42f4-44a8-98c1-5bcfb5e0868c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  785.432450] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Created folder: Project (48e9adbd728148138137b916a3d2fc1d) in parent group-v1161186.
[  785.432590] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Creating folder: Instances. Parent ref: group-v1161254. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  785.434113] env[65478]: DEBUG oslo_vmware.service [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-de341c40-47b2-4c02-b4fe-f9a2cf5a2a3e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  785.443995] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Created folder: Instances in parent group-v1161254.
[  785.445347] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  785.446025] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  785.446025] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-a1cf8f93-9cf6-4908-ac57-ea241c7acd8f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  785.466301] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  785.466301] env[65478]:    value = "task-6011653"
[  785.466301] env[65478]:    _type = "Task"
[  785.466301] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  785.471842] env[65478]: WARNING neutronclient.v2_0.client [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  785.476750] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011653, 'name': CreateVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  785.515878] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2a0d00a6-e2a7-410c-b42a-f173acbbc97f tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Lock "d978e71d-2c30-4a76-b000-6ddf3203ab10" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.715s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  785.521462] env[65478]: INFO nova.compute.manager [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Took 17.04 seconds to build instance.
[  785.524154] env[65478]: DEBUG nova.network.neutron [None req-3b40bd7d-b500-4ca0-a2b8-64a64345af4b tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Updating instance_info_cache with network_info: [{"id": "e599424e-fe74-4d2c-948c-3759b6289f44", "address": "fa:16:3e:c1:84:26", "network": {"id": "386793de-d2e2-4c26-8cab-60dbf2a2ffe3", "bridge": "br-int", "label": "tempest-InstanceActionsTestJSON-2039284656-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "60c31211e0004fe78fab62e554754271", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "50886eea-591a-452c-a27b-5f22cfc9df85", "external-id": "nsx-vlan-transportzone-578", "segmentation_id": 578, "bound_drivers": {"0": "nsxv3"}}, "devname": "tape599424e-fe", "ovs_interfaceid": "e599424e-fe74-4d2c-948c-3759b6289f44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  785.551599] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  785.584216] env[65478]: WARNING neutronclient.v2_0.client [req-0b2a8a81-af4c-4e25-923b-8ebba1fe9c7f req-ccc56c83-bde5-4b92-b154-a12d89699c34 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  785.591585] env[65478]: DEBUG nova.network.neutron [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Successfully created port: 9ccf1586-6b31-4e80-9174-a6868c4d116a {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  785.699422] env[65478]: DEBUG nova.compute.manager [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  785.700453] env[65478]: DEBUG oslo_vmware.service [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9d111e4d-ad49-48a0-81a7-6b9783ae1760 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  785.874116] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Acquiring lock "refresh_cache-95525483-b7db-427e-87b5-3f946972a250" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  785.874116] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Acquired lock "refresh_cache-95525483-b7db-427e-87b5-3f946972a250" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  785.874116] env[65478]: DEBUG nova.network.neutron [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  785.898445] env[65478]: DEBUG oslo_vmware.api [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011650, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.300601} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  785.898725] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  785.899683] env[65478]: DEBUG oslo_vmware.service [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-659b9093-dc3b-4990-9ea5-ac392a028de4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  785.904101] env[65478]: DEBUG nova.scheduler.client.report [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  785.934248] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Reconfiguring VM instance instance-00000017 to attach disk [datastore1] 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc/6ef7bbde-0ba8-44a9-8643-e674a14f3cbc.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  785.935359] env[65478]: DEBUG oslo_vmware.service [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-e0dfe08e-956b-4fd6-a0b3-1505956f7c78 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  785.942147] env[65478]: DEBUG nova.network.neutron [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Updated VIF entry in instance network info cache for port 321b5f6a-6eb5-4a41-86a9-3eac3f4def7b. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  785.948860] env[65478]: DEBUG nova.network.neutron [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Updating instance_info_cache with network_info: [{"id": "321b5f6a-6eb5-4a41-86a9-3eac3f4def7b", "address": "fa:16:3e:16:7e:3c", "network": {"id": "e45f1f2f-7a0a-48b3-b75d-d13d6be57474", "bridge": "br-int", "label": "tempest-ServersAdminTestJSON-393396284-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "a8a09b6e5ab3418e871f2d26fcd10a07", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "3c92f34c-1dd7-4dc5-b8e8-f6c55cc5b4b8", "external-id": "nsx-vlan-transportzone-850", "segmentation_id": 850, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap321b5f6a-6e", "ovs_interfaceid": "321b5f6a-6eb5-4a41-86a9-3eac3f4def7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  785.970520] env[65478]: DEBUG oslo_vmware.api [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for the task: (returnval){
[  785.970520] env[65478]:    value = "task-6011654"
[  785.970520] env[65478]:    _type = "Task"
[  785.970520] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  785.976983] env[65478]: DEBUG nova.network.neutron [req-0b2a8a81-af4c-4e25-923b-8ebba1fe9c7f req-ccc56c83-bde5-4b92-b154-a12d89699c34 service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Updated VIF entry in instance network info cache for port 457c1734-c99a-4d71-a200-0341a9e3bdd8. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  785.977257] env[65478]: DEBUG nova.network.neutron [req-0b2a8a81-af4c-4e25-923b-8ebba1fe9c7f req-ccc56c83-bde5-4b92-b154-a12d89699c34 service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Updating instance_info_cache with network_info: [{"id": "457c1734-c99a-4d71-a200-0341a9e3bdd8", "address": "fa:16:3e:90:77:31", "network": {"id": "eab0e877-79ef-45b8-a26f-7dd517a13b53", "bridge": "br-int", "label": "tempest-FloatingIPsAssociationTestJSON-364284774-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "7dd8c4cd35c44466b1991950f28d886b", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "054fcd1e-638e-425a-a1de-78cb188ae026", "external-id": "nsx-vlan-transportzone-658", "segmentation_id": 658, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap457c1734-c9", "ovs_interfaceid": "457c1734-c99a-4d71-a200-0341a9e3bdd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  785.983359] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011653, 'name': CreateVM_Task} progress is 25%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  785.986775] env[65478]: DEBUG oslo_vmware.api [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011654, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  786.025952] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2818ac30-4bdf-40df-91ca-93fab9ebc42c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "db37d828-c474-4577-816b-6fb2fcd9a82b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.555s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  786.032215] env[65478]: DEBUG oslo_concurrency.lockutils [None req-3b40bd7d-b500-4ca0-a2b8-64a64345af4b tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Releasing lock "refresh_cache-4821048b-4b5a-40b5-8888-f00dd28425d1" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  786.217881] env[65478]: INFO nova.compute.manager [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] instance snapshotting
[  786.220994] env[65478]: DEBUG oslo_vmware.service [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e5fec61f-2794-48d7-96bd-56198dd19a48 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  786.244471] env[65478]: DEBUG oslo_vmware.service [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-243b9693-4cc4-4e4e-9aee-b70e3f16fd04 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  786.321787] env[65478]: DEBUG nova.compute.manager [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Received event network-vif-plugged-60d749ab-453c-414e-a511-3bb1b9f041d0 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  786.321787] env[65478]: DEBUG oslo_concurrency.lockutils [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] Acquiring lock "6ef7bbde-0ba8-44a9-8643-e674a14f3cbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  786.322012] env[65478]: DEBUG oslo_concurrency.lockutils [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] Lock "6ef7bbde-0ba8-44a9-8643-e674a14f3cbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  786.322012] env[65478]: DEBUG oslo_concurrency.lockutils [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] Lock "6ef7bbde-0ba8-44a9-8643-e674a14f3cbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  786.322098] env[65478]: DEBUG nova.compute.manager [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] No waiting events found dispatching network-vif-plugged-60d749ab-453c-414e-a511-3bb1b9f041d0 {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  786.322199] env[65478]: WARNING nova.compute.manager [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Received unexpected event network-vif-plugged-60d749ab-453c-414e-a511-3bb1b9f041d0 for instance with vm_state building and task_state spawning.
[  786.322318] env[65478]: DEBUG nova.compute.manager [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Received event network-changed-60d749ab-453c-414e-a511-3bb1b9f041d0 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  786.322466] env[65478]: DEBUG nova.compute.manager [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Refreshing instance network info cache due to event network-changed-60d749ab-453c-414e-a511-3bb1b9f041d0. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  786.322605] env[65478]: DEBUG oslo_concurrency.lockutils [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] Acquiring lock "refresh_cache-6ef7bbde-0ba8-44a9-8643-e674a14f3cbc" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  786.322700] env[65478]: DEBUG oslo_concurrency.lockutils [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] Acquired lock "refresh_cache-6ef7bbde-0ba8-44a9-8643-e674a14f3cbc" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  786.322812] env[65478]: DEBUG nova.network.neutron [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Refreshing network info cache for port 60d749ab-453c-414e-a511-3bb1b9f041d0 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  786.355102] env[65478]: DEBUG nova.compute.manager [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  786.380363] env[65478]: WARNING neutronclient.v2_0.client [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  786.393681] env[65478]: DEBUG nova.virt.hardware [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  786.393681] env[65478]: DEBUG nova.virt.hardware [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  786.393910] env[65478]: DEBUG nova.virt.hardware [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  786.393964] env[65478]: DEBUG nova.virt.hardware [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  786.395018] env[65478]: DEBUG nova.virt.hardware [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  786.395018] env[65478]: DEBUG nova.virt.hardware [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  786.395018] env[65478]: DEBUG nova.virt.hardware [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  786.395018] env[65478]: DEBUG nova.virt.hardware [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  786.395018] env[65478]: DEBUG nova.virt.hardware [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  786.395250] env[65478]: DEBUG nova.virt.hardware [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  786.395250] env[65478]: DEBUG nova.virt.hardware [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  786.396233] env[65478]: DEBUG oslo_vmware.service [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e8770c03-977b-4790-a714-a58a314130be {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  786.409588] env[65478]: DEBUG oslo_vmware.service [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4f807120-d06f-4554-9ade-0950145372d0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  786.434571] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.182s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  786.436673] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 6.843s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  786.436854] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  786.437011] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[  786.437908] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b867a6df-cb9d-417a-b7a1-1bd03fb4b82b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  786.441027] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 6.472s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  786.442677] env[65478]: INFO nova.compute.claims [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  786.451901] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-fa570dfa-c811-42e6-aee1-004a9d72fac3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  786.481629] env[65478]: DEBUG oslo_concurrency.lockutils [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] Releasing lock "refresh_cache-db37d828-c474-4577-816b-6fb2fcd9a82b" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  786.481705] env[65478]: DEBUG nova.compute.manager [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Received event network-changed-fe1047e6-be6d-4718-a53e-e21e2b96dcc9 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  786.481808] env[65478]: DEBUG nova.compute.manager [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Refreshing instance network info cache due to event network-changed-fe1047e6-be6d-4718-a53e-e21e2b96dcc9. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  786.482860] env[65478]: DEBUG oslo_concurrency.lockutils [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] Acquiring lock "refresh_cache-eb466e5e-a499-4856-9c12-c7ca87b53230" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  786.482860] env[65478]: DEBUG oslo_concurrency.lockutils [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] Acquired lock "refresh_cache-eb466e5e-a499-4856-9c12-c7ca87b53230" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  786.482860] env[65478]: DEBUG nova.network.neutron [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Refreshing network info cache for port fe1047e6-be6d-4718-a53e-e21e2b96dcc9 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  786.485267] env[65478]: DEBUG oslo_concurrency.lockutils [req-0b2a8a81-af4c-4e25-923b-8ebba1fe9c7f req-ccc56c83-bde5-4b92-b154-a12d89699c34 service nova] Releasing lock "refresh_cache-caf7856c-4e51-4e6c-ad32-2088e15d5d8f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  786.491828] env[65478]: DEBUG nova.network.neutron [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  786.496295] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a33d1ed1-ec59-4be4-964d-9716bda13cdb {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  786.500856] env[65478]: DEBUG nova.compute.manager [req-0b2a8a81-af4c-4e25-923b-8ebba1fe9c7f req-ccc56c83-bde5-4b92-b154-a12d89699c34 service nova] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Received event network-changed-958d3060-f044-4655-8c5e-bd81773ad096 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  786.510868] env[65478]: INFO nova.scheduler.client.report [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Deleted allocations for instance 6a23cbd2-7031-484c-809e-436397029c7d
[  786.517920] env[65478]: DEBUG nova.compute.manager [req-0b2a8a81-af4c-4e25-923b-8ebba1fe9c7f req-ccc56c83-bde5-4b92-b154-a12d89699c34 service nova] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Refreshing instance network info cache due to event network-changed-958d3060-f044-4655-8c5e-bd81773ad096. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  786.523748] env[65478]: DEBUG oslo_concurrency.lockutils [req-0b2a8a81-af4c-4e25-923b-8ebba1fe9c7f req-ccc56c83-bde5-4b92-b154-a12d89699c34 service nova] Acquiring lock "refresh_cache-88cd130c-b811-4789-aea2-964848abdd69" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  786.524160] env[65478]: DEBUG oslo_concurrency.lockutils [req-0b2a8a81-af4c-4e25-923b-8ebba1fe9c7f req-ccc56c83-bde5-4b92-b154-a12d89699c34 service nova] Acquired lock "refresh_cache-88cd130c-b811-4789-aea2-964848abdd69" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  786.532901] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-523b5b2d-fbe0-4dff-a3bb-42cfb75cecb2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  786.543629] env[65478]: DEBUG oslo_vmware.api [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011654, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  786.546036] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011653, 'name': CreateVM_Task, 'duration_secs': 0.709256} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  786.552060] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  786.580633] env[65478]: DEBUG nova.network.neutron [req-0b2a8a81-af4c-4e25-923b-8ebba1fe9c7f req-ccc56c83-bde5-4b92-b154-a12d89699c34 service nova] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Refreshing network info cache for port 958d3060-f044-4655-8c5e-bd81773ad096 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  786.582209] env[65478]: DEBUG nova.compute.manager [None req-3b40bd7d-b500-4ca0-a2b8-64a64345af4b tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  786.584666] env[65478]: WARNING neutronclient.v2_0.client [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  786.585154] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=180264MB free_disk=93GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[  786.585630] env[65478]: DEBUG oslo_vmware.service [None req-3b40bd7d-b500-4ca0-a2b8-64a64345af4b tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c1a554e8-79d3-48d9-8c12-43c44736ad0e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  786.590621] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Acquiring lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  786.592203] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  786.603958] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Acquired lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  786.604876] env[65478]: DEBUG oslo_concurrency.lockutils [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Acquiring lock "88cd130c-b811-4789-aea2-964848abdd69" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  786.606357] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Acquired external semaphore "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  786.606548] env[65478]: DEBUG oslo_vmware.service [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-b64902a9-5c27-442b-b565-b6a4dc8fa5a6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  786.608833] env[65478]: DEBUG oslo_concurrency.lockutils [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Lock "88cd130c-b811-4789-aea2-964848abdd69" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.013s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  786.610077] env[65478]: DEBUG oslo_concurrency.lockutils [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Acquiring lock "88cd130c-b811-4789-aea2-964848abdd69-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  786.611185] env[65478]: DEBUG oslo_concurrency.lockutils [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Lock "88cd130c-b811-4789-aea2-964848abdd69-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  786.611185] env[65478]: DEBUG oslo_concurrency.lockutils [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Lock "88cd130c-b811-4789-aea2-964848abdd69-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  786.614558] env[65478]: DEBUG oslo_vmware.api [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Waiting for the task: (returnval){
[  786.614558] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c8ae45-8450-1b13-b9a3-dfbfe00437f0"
[  786.614558] env[65478]:    _type = "Task"
[  786.614558] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  786.620105] env[65478]: INFO nova.compute.manager [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Terminating instance
[  786.625585] env[65478]: DEBUG oslo_vmware.api [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c8ae45-8450-1b13-b9a3-dfbfe00437f0, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  786.663150] env[65478]: DEBUG nova.network.neutron [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  786.755189] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Creating Snapshot of the VM instance {{(pid=65478) _create_vm_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:913}}
[  786.755523] env[65478]: DEBUG oslo_vmware.service [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking VirtualMachine.CreateSnapshot_Task with opID=oslo.vmware-e84f70a2-211f-4f8c-8b6d-41e9bc92b1f4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  786.762723] env[65478]: DEBUG oslo_vmware.api [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Waiting for the task: (returnval){
[  786.762723] env[65478]:    value = "task-6011655"
[  786.762723] env[65478]:    _type = "Task"
[  786.762723] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  786.771538] env[65478]: DEBUG oslo_vmware.api [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011655, 'name': CreateSnapshot_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  786.825852] env[65478]: WARNING neutronclient.v2_0.client [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  786.850572] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Acquiring lock "788343e6-5c24-4e9b-9c74-e14f3b179cdb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  786.850818] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Lock "788343e6-5c24-4e9b-9c74-e14f3b179cdb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  786.851015] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Acquiring lock "788343e6-5c24-4e9b-9c74-e14f3b179cdb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  786.851172] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Lock "788343e6-5c24-4e9b-9c74-e14f3b179cdb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  786.851330] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Lock "788343e6-5c24-4e9b-9c74-e14f3b179cdb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  786.853624] env[65478]: INFO nova.compute.manager [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Terminating instance
[  786.990351] env[65478]: WARNING neutronclient.v2_0.client [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  786.998434] env[65478]: DEBUG oslo_vmware.api [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011654, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  787.039034] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a14955ae-d518-4c21-9718-dc2eaaad5a7b tempest-VolumesAdminNegativeTest-1266721552 tempest-VolumesAdminNegativeTest-1266721552-project-member] Lock "6a23cbd2-7031-484c-809e-436397029c7d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.342s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  787.093137] env[65478]: WARNING neutronclient.v2_0.client [req-0b2a8a81-af4c-4e25-923b-8ebba1fe9c7f req-ccc56c83-bde5-4b92-b154-a12d89699c34 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  787.125944] env[65478]: DEBUG oslo_vmware.api [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c8ae45-8450-1b13-b9a3-dfbfe00437f0, 'name': SearchDatastore_Task, 'duration_secs': 0.009884} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  787.126197] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Releasing lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  787.126391] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  787.126653] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Acquiring lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  787.126744] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Acquired lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  787.126820] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Creating directory with path [datastore2] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  787.127119] env[65478]: DEBUG oslo_vmware.service [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-1f07d975-8a99-4398-aa91-fe74c11bafc0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  787.130598] env[65478]: DEBUG nova.compute.manager [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[  787.130778] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  787.131686] env[65478]: DEBUG oslo_vmware.service [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-69728218-4165-41d7-9ff9-0c2cefd76036 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  787.139772] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Created directory with path [datastore2] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  787.140163] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Folder [datastore2] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  787.140723] env[65478]: DEBUG oslo_vmware.service [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-51c970ea-be2a-4361-bed8-3ed7f6cd3ff2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  787.148671] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  787.150516] env[65478]: DEBUG oslo_vmware.api [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Waiting for the task: (returnval){
[  787.150516] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c9d79e-d90e-0b3b-e4a6-153871a865a9"
[  787.150516] env[65478]:    _type = "Task"
[  787.150516] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  787.153543] env[65478]: DEBUG oslo_vmware.service [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-9b429cc4-0502-4686-90e1-c519190cac56 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  787.161603] env[65478]: DEBUG oslo_vmware.api [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c9d79e-d90e-0b3b-e4a6-153871a865a9, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  787.164144] env[65478]: DEBUG oslo_vmware.api [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for the task: (returnval){
[  787.164144] env[65478]:    value = "task-6011656"
[  787.164144] env[65478]:    _type = "Task"
[  787.164144] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  787.168749] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Releasing lock "refresh_cache-95525483-b7db-427e-87b5-3f946972a250" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  787.169529] env[65478]: DEBUG nova.compute.manager [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[  787.169529] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  787.170705] env[65478]: DEBUG oslo_vmware.service [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-898242f0-dc6e-47a8-8e14-e27e3ae37c0c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  787.181906] env[65478]: DEBUG oslo_vmware.api [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011656, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  787.187565] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  787.187565] env[65478]: DEBUG oslo_vmware.service [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-759903c6-4781-4be3-a501-118f99e5da54 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  787.193142] env[65478]: DEBUG oslo_vmware.api [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Waiting for the task: (returnval){
[  787.193142] env[65478]:    value = "task-6011657"
[  787.193142] env[65478]:    _type = "Task"
[  787.193142] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  787.209133] env[65478]: DEBUG oslo_vmware.api [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011657, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  787.274017] env[65478]: DEBUG oslo_vmware.api [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011655, 'name': CreateSnapshot_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  787.334240] env[65478]: DEBUG nova.network.neutron [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Successfully updated port: 9ccf1586-6b31-4e80-9174-a6868c4d116a {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  787.357960] env[65478]: DEBUG nova.compute.manager [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[  787.358879] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  787.362827] env[65478]: DEBUG oslo_vmware.service [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-cb11313c-8df2-43de-a174-82f5fc49d892 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  787.373629] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  787.374161] env[65478]: DEBUG oslo_vmware.service [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-48a653a6-2de2-475e-93b6-39a04f32ad33 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  787.384649] env[65478]: DEBUG oslo_vmware.api [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Waiting for the task: (returnval){
[  787.384649] env[65478]:    value = "task-6011658"
[  787.384649] env[65478]:    _type = "Task"
[  787.384649] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  787.397124] env[65478]: DEBUG oslo_vmware.api [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011658, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  787.491161] env[65478]: DEBUG oslo_vmware.api [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011654, 'name': ReconfigVM_Task, 'duration_secs': 1.091636} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  787.491510] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Reconfigured VM instance instance-00000017 to attach disk [datastore1] 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc/6ef7bbde-0ba8-44a9-8643-e674a14f3cbc.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  787.492271] env[65478]: DEBUG oslo_vmware.service [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-031ac225-404a-41c7-92b4-1268a3037153 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  787.499845] env[65478]: WARNING neutronclient.v2_0.client [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  787.508143] env[65478]: DEBUG oslo_vmware.api [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for the task: (returnval){
[  787.508143] env[65478]:    value = "task-6011659"
[  787.508143] env[65478]:    _type = "Task"
[  787.508143] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  787.516740] env[65478]: DEBUG oslo_vmware.api [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011659, 'name': Rename_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  787.618029] env[65478]: DEBUG oslo_vmware.service [None req-3b40bd7d-b500-4ca0-a2b8-64a64345af4b tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-074c7577-c1b8-470a-b5d3-cede6bf067d4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  787.625935] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-3b40bd7d-b500-4ca0-a2b8-64a64345af4b tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Doing hard reboot of VM {{(pid=65478) reboot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1063}}
[  787.629754] env[65478]: DEBUG oslo_vmware.service [None req-3b40bd7d-b500-4ca0-a2b8-64a64345af4b tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking VirtualMachine.ResetVM_Task with opID=oslo.vmware-9ccb2c06-48c3-4b70-8fc5-145b9e4710ae {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  787.634873] env[65478]: DEBUG oslo_vmware.api [None req-3b40bd7d-b500-4ca0-a2b8-64a64345af4b tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Waiting for the task: (returnval){
[  787.634873] env[65478]:    value = "task-6011660"
[  787.634873] env[65478]:    _type = "Task"
[  787.634873] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  787.646431] env[65478]: DEBUG oslo_vmware.api [None req-3b40bd7d-b500-4ca0-a2b8-64a64345af4b tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Task: {'id': task-6011660, 'name': ResetVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  787.668060] env[65478]: DEBUG oslo_vmware.api [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c9d79e-d90e-0b3b-e4a6-153871a865a9, 'name': SearchDatastore_Task, 'duration_secs': 0.014501} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  787.668060] env[65478]: DEBUG oslo_vmware.service [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-6c578f7f-13f5-43f2-ad67-9a832cb3c88c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  787.677833] env[65478]: DEBUG nova.network.neutron [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Updated VIF entry in instance network info cache for port 60d749ab-453c-414e-a511-3bb1b9f041d0. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  787.679235] env[65478]: DEBUG nova.network.neutron [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Updating instance_info_cache with network_info: [{"id": "60d749ab-453c-414e-a511-3bb1b9f041d0", "address": "fa:16:3e:1c:b9:33", "network": {"id": "cf40b8d0-87c8-445d-9b09-7d7b98212c02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1605028920-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8de0dd2b26b24b4fb6e13f475974035a", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "423047aa-c430-4593-a76c-9982c15c81cf", "external-id": "nsx-vlan-transportzone-262", "segmentation_id": 262, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap60d749ab-45", "ovs_interfaceid": "60d749ab-453c-414e-a511-3bb1b9f041d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  787.691998] env[65478]: DEBUG oslo_vmware.api [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Waiting for the task: (returnval){
[  787.691998] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52031831-1251-902c-9cc6-2367a7723e06"
[  787.691998] env[65478]:    _type = "Task"
[  787.691998] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  787.703553] env[65478]: DEBUG oslo_vmware.api [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011656, 'name': PowerOffVM_Task, 'duration_secs': 0.202081} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  787.703826] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  787.705016] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  787.705016] env[65478]: DEBUG oslo_vmware.service [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-e9745c65-f338-4ace-94b5-0133afeb0f9e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  787.723992] env[65478]: WARNING neutronclient.v2_0.client [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  787.778555] env[65478]: DEBUG oslo_vmware.api [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52031831-1251-902c-9cc6-2367a7723e06, 'name': SearchDatastore_Task, 'duration_secs': 0.022069} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  787.780018] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Releasing lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  787.780437] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Copying Virtual Disk [datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore2] b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f/b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  787.785397] env[65478]: DEBUG oslo_vmware.service [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-12ac6938-11dc-4913-a817-70e6aec6c800 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  787.799474] env[65478]: DEBUG oslo_vmware.api [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011657, 'name': PowerOffVM_Task, 'duration_secs': 0.182353} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  787.800266] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  787.806240] env[65478]: DEBUG oslo_vmware.api [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011655, 'name': CreateSnapshot_Task, 'duration_secs': 0.807762} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  787.807458] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  787.810573] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Created Snapshot of the VM instance {{(pid=65478) _create_vm_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:922}}
[  787.811958] env[65478]: DEBUG oslo_vmware.api [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Waiting for the task: (returnval){
[  787.811958] env[65478]:    value = "task-6011662"
[  787.811958] env[65478]:    _type = "Task"
[  787.811958] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  787.819608] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  787.822088] env[65478]: DEBUG oslo_vmware.service [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-ef000914-a39c-4002-ab59-50dbf07b8d6a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  787.840470] env[65478]: DEBUG oslo_vmware.service [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d3238b8e-fa87-42a2-a88f-b440c22fbdd2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  787.847065] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Deleting contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  787.847418] env[65478]: DEBUG oslo_vmware.api [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Task: {'id': task-6011662, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  787.848607] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "refresh_cache-c0545749-bc03-4f28-a0d4-ebaf55049095" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  787.862791] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquired lock "refresh_cache-c0545749-bc03-4f28-a0d4-ebaf55049095" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  787.868165] env[65478]: DEBUG nova.compute.manager [req-f170fc94-655c-4d89-93b0-cef10c585626 req-d6c7d6b3-ad0b-4540-a8b6-f8e49480fcc0 service nova] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Received event network-vif-plugged-69013773-3f93-4432-9c5b-6726964a77d9 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  787.870125] env[65478]: DEBUG nova.network.neutron [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  787.871516] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Deleting the datastore file [datastore1] 88cd130c-b811-4789-aea2-964848abdd69 {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  787.873236] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  787.873374] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Deleting contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  787.873723] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Deleting the datastore file [datastore1] 95525483-b7db-427e-87b5-3f946972a250 {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  787.873867] env[65478]: DEBUG oslo_vmware.service [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-f3fc2af4-1492-49e4-9d0b-48e3ce6507ed {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  787.876638] env[65478]: DEBUG oslo_vmware.service [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-b4aeaf01-2722-46c5-92c7-2fb4961ce72c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  787.881449] env[65478]: DEBUG oslo_concurrency.lockutils [req-f170fc94-655c-4d89-93b0-cef10c585626 req-d6c7d6b3-ad0b-4540-a8b6-f8e49480fcc0 service nova] Acquiring lock "b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  787.883213] env[65478]: WARNING neutronclient.v2_0.client [req-0b2a8a81-af4c-4e25-923b-8ebba1fe9c7f req-ccc56c83-bde5-4b92-b154-a12d89699c34 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  787.889071] env[65478]: DEBUG oslo_concurrency.lockutils [req-f170fc94-655c-4d89-93b0-cef10c585626 req-d6c7d6b3-ad0b-4540-a8b6-f8e49480fcc0 service nova] Lock "b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.012s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  787.901472] env[65478]: DEBUG oslo_vmware.api [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for the task: (returnval){
[  787.901472] env[65478]:    value = "task-6011665"
[  787.901472] env[65478]:    _type = "Task"
[  787.901472] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  787.912661] env[65478]: DEBUG oslo_vmware.api [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Waiting for the task: (returnval){
[  787.912661] env[65478]:    value = "task-6011664"
[  787.912661] env[65478]:    _type = "Task"
[  787.912661] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  787.928148] env[65478]: DEBUG oslo_concurrency.lockutils [req-f170fc94-655c-4d89-93b0-cef10c585626 req-d6c7d6b3-ad0b-4540-a8b6-f8e49480fcc0 service nova] Lock "b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.014s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  787.928328] env[65478]: DEBUG nova.compute.manager [req-f170fc94-655c-4d89-93b0-cef10c585626 req-d6c7d6b3-ad0b-4540-a8b6-f8e49480fcc0 service nova] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] No waiting events found dispatching network-vif-plugged-69013773-3f93-4432-9c5b-6726964a77d9 {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  787.928506] env[65478]: WARNING nova.compute.manager [req-f170fc94-655c-4d89-93b0-cef10c585626 req-d6c7d6b3-ad0b-4540-a8b6-f8e49480fcc0 service nova] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Received unexpected event network-vif-plugged-69013773-3f93-4432-9c5b-6726964a77d9 for instance with vm_state building and task_state spawning.
[  787.931194] env[65478]: DEBUG oslo_vmware.api [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011658, 'name': PowerOffVM_Task, 'duration_secs': 0.224173} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  787.931441] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  787.931574] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  787.931867] env[65478]: DEBUG oslo_vmware.service [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-19e6294c-d0c8-49f9-a2f5-a5d10b7fa551 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  787.950370] env[65478]: DEBUG nova.compute.manager [req-f170fc94-655c-4d89-93b0-cef10c585626 req-d6c7d6b3-ad0b-4540-a8b6-f8e49480fcc0 service nova] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Received event network-changed-69013773-3f93-4432-9c5b-6726964a77d9 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  787.951241] env[65478]: DEBUG oslo_vmware.api [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011664, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  787.951241] env[65478]: DEBUG oslo_vmware.api [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011665, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  787.951656] env[65478]: DEBUG nova.network.neutron [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Updated VIF entry in instance network info cache for port fe1047e6-be6d-4718-a53e-e21e2b96dcc9. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  787.952077] env[65478]: DEBUG nova.compute.manager [req-f170fc94-655c-4d89-93b0-cef10c585626 req-d6c7d6b3-ad0b-4540-a8b6-f8e49480fcc0 service nova] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Refreshing instance network info cache due to event network-changed-69013773-3f93-4432-9c5b-6726964a77d9. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  787.952548] env[65478]: DEBUG nova.network.neutron [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Updating instance_info_cache with network_info: [{"id": "fe1047e6-be6d-4718-a53e-e21e2b96dcc9", "address": "fa:16:3e:d1:4a:a6", "network": {"id": "7f931794-a55e-4262-acec-b60daf9cf019", "bridge": "br-int", "label": "tempest-ServersTestManualDisk-1906004701-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "10.180.180.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "4d4c6f3c8d4a40f68deffc1fd31d86ba", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "6b151a0c-aa46-4d21-9ef5-c09cf350b19c", "external-id": "nsx-vlan-transportzone-343", "segmentation_id": 343, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapfe1047e6-be", "ovs_interfaceid": "fe1047e6-be6d-4718-a53e-e21e2b96dcc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  787.953931] env[65478]: DEBUG oslo_concurrency.lockutils [req-f170fc94-655c-4d89-93b0-cef10c585626 req-d6c7d6b3-ad0b-4540-a8b6-f8e49480fcc0 service nova] Acquiring lock "refresh_cache-b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  787.954455] env[65478]: DEBUG oslo_concurrency.lockutils [req-f170fc94-655c-4d89-93b0-cef10c585626 req-d6c7d6b3-ad0b-4540-a8b6-f8e49480fcc0 service nova] Acquired lock "refresh_cache-b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  787.954755] env[65478]: DEBUG nova.network.neutron [req-f170fc94-655c-4d89-93b0-cef10c585626 req-d6c7d6b3-ad0b-4540-a8b6-f8e49480fcc0 service nova] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Refreshing network info cache for port 69013773-3f93-4432-9c5b-6726964a77d9 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  788.004164] env[65478]: DEBUG oslo_vmware.service [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8b6e211e-0fc2-4bdc-90ff-b565ee20f904 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  788.016441] env[65478]: DEBUG oslo_vmware.service [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c1eeebc8-cb25-4850-99b8-92b3c9991952 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  788.024761] env[65478]: DEBUG oslo_vmware.api [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011659, 'name': Rename_Task, 'duration_secs': 0.225225} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  788.025506] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  788.031253] env[65478]: DEBUG oslo_vmware.service [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-fe67a11e-7601-47aa-a1d9-d24574233b92 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  788.060521] env[65478]: DEBUG oslo_vmware.api [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for the task: (returnval){
[  788.060521] env[65478]:    value = "task-6011667"
[  788.060521] env[65478]:    _type = "Task"
[  788.060521] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  788.068059] env[65478]: DEBUG oslo_vmware.service [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9f70f617-378e-4e49-a8ea-ce00af774c52 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  788.076648] env[65478]: DEBUG oslo_vmware.api [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011667, 'name': PowerOnVM_Task} progress is 66%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  788.083056] env[65478]: DEBUG oslo_vmware.service [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-5bcd39a3-d044-4139-8ebf-069b35b215b4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  788.102727] env[65478]: DEBUG nova.compute.provider_tree [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  788.127170] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  788.130839] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Deleting contents of the VM from datastore datastore2 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  788.130839] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Deleting the datastore file [datastore2] 788343e6-5c24-4e9b-9c74-e14f3b179cdb {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  788.130839] env[65478]: DEBUG oslo_vmware.service [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-d8236783-c28b-41b4-83ac-4134ba94b38c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  788.136495] env[65478]: DEBUG oslo_vmware.api [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Waiting for the task: (returnval){
[  788.136495] env[65478]:    value = "task-6011668"
[  788.136495] env[65478]:    _type = "Task"
[  788.136495] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  788.158768] env[65478]: DEBUG oslo_vmware.api [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011668, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  788.165018] env[65478]: DEBUG oslo_vmware.api [None req-3b40bd7d-b500-4ca0-a2b8-64a64345af4b tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Task: {'id': task-6011660, 'name': ResetVM_Task, 'duration_secs': 0.099524} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  788.165915] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-3b40bd7d-b500-4ca0-a2b8-64a64345af4b tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Did hard reboot of VM {{(pid=65478) reboot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1067}}
[  788.165915] env[65478]: DEBUG nova.compute.manager [None req-3b40bd7d-b500-4ca0-a2b8-64a64345af4b tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  788.167739] env[65478]: DEBUG oslo_vmware.service [None req-3b40bd7d-b500-4ca0-a2b8-64a64345af4b tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b2d0f95e-133c-4509-a2ad-05ab243fe34c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  788.202866] env[65478]: DEBUG oslo_concurrency.lockutils [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] Releasing lock "refresh_cache-6ef7bbde-0ba8-44a9-8643-e674a14f3cbc" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  788.203115] env[65478]: DEBUG nova.compute.manager [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Received event network-changed-5c9a8578-bb94-4d72-acef-25b60278df21 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  788.203246] env[65478]: DEBUG nova.compute.manager [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Refreshing instance network info cache due to event network-changed-5c9a8578-bb94-4d72-acef-25b60278df21. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  788.203733] env[65478]: DEBUG oslo_concurrency.lockutils [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] Acquiring lock "refresh_cache-eb076624-c76c-47da-9320-5fc13a51b365" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  788.203733] env[65478]: DEBUG oslo_concurrency.lockutils [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] Acquired lock "refresh_cache-eb076624-c76c-47da-9320-5fc13a51b365" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  788.203733] env[65478]: DEBUG nova.network.neutron [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Refreshing network info cache for port 5c9a8578-bb94-4d72-acef-25b60278df21 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  788.326170] env[65478]: DEBUG oslo_vmware.api [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Task: {'id': task-6011662, 'name': CopyVirtualDisk_Task} progress is 51%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  788.386758] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Creating linked-clone VM from snapshot {{(pid=65478) _create_linked_clone_from_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:955}}
[  788.388460] env[65478]: DEBUG oslo_vmware.service [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking VirtualMachine.CloneVM_Task with opID=oslo.vmware-ff8d25a2-fe9f-4cac-a659-4e6f6399fe59 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  788.399585] env[65478]: DEBUG oslo_vmware.api [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Waiting for the task: (returnval){
[  788.399585] env[65478]:    value = "task-6011669"
[  788.399585] env[65478]:    _type = "Task"
[  788.399585] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  788.415295] env[65478]: DEBUG oslo_vmware.api [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011669, 'name': CloneVM_Task} progress is 5%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  788.422900] env[65478]: DEBUG oslo_vmware.api [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011665, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.201501} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  788.425324] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  788.425484] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Deleted contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  788.425624] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  788.425781] env[65478]: INFO nova.compute.manager [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Took 1.30 seconds to destroy the instance on the hypervisor.
[  788.426924] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  788.426924] env[65478]: DEBUG nova.compute.manager [-] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[  788.428135] env[65478]: DEBUG nova.network.neutron [-] [instance: 88cd130c-b811-4789-aea2-964848abdd69] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[  788.428135] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  788.433976] env[65478]: DEBUG oslo_vmware.api [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Task: {'id': task-6011664, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.108321} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  788.435156] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  788.435156] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Deleted contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  788.435156] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  788.435156] env[65478]: INFO nova.compute.manager [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] [instance: 95525483-b7db-427e-87b5-3f946972a250] Took 1.27 seconds to destroy the instance on the hypervisor.
[  788.436610] env[65478]: DEBUG nova.network.neutron [req-0b2a8a81-af4c-4e25-923b-8ebba1fe9c7f req-ccc56c83-bde5-4b92-b154-a12d89699c34 service nova] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Updated VIF entry in instance network info cache for port 958d3060-f044-4655-8c5e-bd81773ad096. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  788.437262] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  788.437897] env[65478]: DEBUG nova.network.neutron [req-0b2a8a81-af4c-4e25-923b-8ebba1fe9c7f req-ccc56c83-bde5-4b92-b154-a12d89699c34 service nova] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Updating instance_info_cache with network_info: [{"id": "958d3060-f044-4655-8c5e-bd81773ad096", "address": "fa:16:3e:d1:a0:bc", "network": {"id": "eab0e877-79ef-45b8-a26f-7dd517a13b53", "bridge": "br-int", "label": "tempest-FloatingIPsAssociationTestJSON-364284774-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "7dd8c4cd35c44466b1991950f28d886b", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "054fcd1e-638e-425a-a1de-78cb188ae026", "external-id": "nsx-vlan-transportzone-658", "segmentation_id": 658, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap958d3060-f0", "ovs_interfaceid": "958d3060-f044-4655-8c5e-bd81773ad096", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  788.438877] env[65478]: DEBUG nova.compute.manager [-] [instance: 95525483-b7db-427e-87b5-3f946972a250] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[  788.440955] env[65478]: DEBUG nova.network.neutron [-] [instance: 95525483-b7db-427e-87b5-3f946972a250] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[  788.440955] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  788.456604] env[65478]: DEBUG oslo_concurrency.lockutils [req-d9f03a7e-d922-4246-acf0-8df00051d95c req-1a99a0d6-e123-4f51-a7b6-e6ef1be3cdbd service nova] Releasing lock "refresh_cache-eb466e5e-a499-4856-9c12-c7ca87b53230" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  788.459150] env[65478]: WARNING neutronclient.v2_0.client [req-f170fc94-655c-4d89-93b0-cef10c585626 req-d6c7d6b3-ad0b-4540-a8b6-f8e49480fcc0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  788.573774] env[65478]: DEBUG oslo_vmware.api [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011667, 'name': PowerOnVM_Task} progress is 89%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  788.583879] env[65478]: DEBUG nova.network.neutron [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  788.606328] env[65478]: DEBUG nova.scheduler.client.report [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  788.648619] env[65478]: DEBUG oslo_vmware.api [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Task: {'id': task-6011668, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.460608} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  788.649817] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  788.649817] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Deleted contents of the VM from datastore datastore2 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  788.650369] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  788.651619] env[65478]: INFO nova.compute.manager [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Took 1.29 seconds to destroy the instance on the hypervisor.
[  788.652035] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  788.652287] env[65478]: DEBUG nova.compute.manager [-] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[  788.652403] env[65478]: DEBUG nova.network.neutron [-] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[  788.652669] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  788.687468] env[65478]: DEBUG oslo_concurrency.lockutils [None req-3b40bd7d-b500-4ca0-a2b8-64a64345af4b tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Lock "4821048b-4b5a-40b5-8888-f00dd28425d1" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 5.384s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  788.708792] env[65478]: WARNING neutronclient.v2_0.client [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  788.779782] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  788.792681] env[65478]: DEBUG nova.network.neutron [-] [instance: 95525483-b7db-427e-87b5-3f946972a250] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  788.792952] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  788.827974] env[65478]: DEBUG oslo_vmware.api [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Task: {'id': task-6011662, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.65844} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  788.829129] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Copied Virtual Disk [datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore2] b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f/b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  788.829129] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  788.829821] env[65478]: DEBUG oslo_vmware.service [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-b73134f0-c7f9-4739-b189-1ed47e2a2dd7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  788.842133] env[65478]: DEBUG oslo_vmware.api [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Waiting for the task: (returnval){
[  788.842133] env[65478]:    value = "task-6011670"
[  788.842133] env[65478]:    _type = "Task"
[  788.842133] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  788.856078] env[65478]: DEBUG oslo_vmware.api [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Task: {'id': task-6011670, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  788.911420] env[65478]: DEBUG oslo_vmware.api [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011669, 'name': CloneVM_Task} progress is 94%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  788.942349] env[65478]: DEBUG oslo_concurrency.lockutils [req-0b2a8a81-af4c-4e25-923b-8ebba1fe9c7f req-ccc56c83-bde5-4b92-b154-a12d89699c34 service nova] Releasing lock "refresh_cache-88cd130c-b811-4789-aea2-964848abdd69" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  788.942571] env[65478]: DEBUG nova.compute.manager [req-0b2a8a81-af4c-4e25-923b-8ebba1fe9c7f req-ccc56c83-bde5-4b92-b154-a12d89699c34 service nova] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Received event network-vif-deleted-0d1a1269-dc87-4884-8918-e8ebaaa034f7 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  789.072100] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  789.079923] env[65478]: DEBUG oslo_vmware.api [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011667, 'name': PowerOnVM_Task, 'duration_secs': 0.985127} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  789.080186] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  789.080356] env[65478]: INFO nova.compute.manager [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Took 9.14 seconds to spawn the instance on the hypervisor.
[  789.080496] env[65478]: DEBUG nova.compute.manager [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  789.081644] env[65478]: DEBUG oslo_vmware.service [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-19eb508c-a3fc-42f2-ad9f-418a958225d8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  789.113254] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.672s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  789.116639] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 7.376s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  789.120638] env[65478]: DEBUG nova.compute.manager [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  789.125633] env[65478]: INFO nova.compute.claims [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  789.295454] env[65478]: DEBUG nova.network.neutron [-] [instance: 95525483-b7db-427e-87b5-3f946972a250] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  789.353748] env[65478]: DEBUG oslo_vmware.api [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Task: {'id': task-6011670, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.219555} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  789.353986] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  789.354814] env[65478]: DEBUG oslo_vmware.service [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a9e8bfbf-cdfc-4277-95d9-7b87189baea3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  789.395431] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Reconfiguring VM instance instance-00000018 to attach disk [datastore2] b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f/b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  789.395818] env[65478]: DEBUG oslo_vmware.service [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-68accf9a-4545-45a7-8dd0-b869f328c6c1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  789.441379] env[65478]: DEBUG oslo_vmware.api [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011669, 'name': CloneVM_Task} progress is 94%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  789.445076] env[65478]: WARNING neutronclient.v2_0.client [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  789.448600] env[65478]: DEBUG oslo_vmware.api [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Waiting for the task: (returnval){
[  789.448600] env[65478]:    value = "task-6011671"
[  789.448600] env[65478]:    _type = "Task"
[  789.448600] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  789.458723] env[65478]: DEBUG oslo_vmware.api [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Task: {'id': task-6011671, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  789.601708] env[65478]: INFO nova.compute.manager [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Took 16.74 seconds to build instance.
[  789.637375] env[65478]: DEBUG nova.compute.utils [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  789.637977] env[65478]: DEBUG nova.compute.manager [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  789.638506] env[65478]: DEBUG nova.network.neutron [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  789.638818] env[65478]: WARNING neutronclient.v2_0.client [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  789.639139] env[65478]: WARNING neutronclient.v2_0.client [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  789.811205] env[65478]: INFO nova.compute.manager [-] [instance: 95525483-b7db-427e-87b5-3f946972a250] Took 1.37 seconds to deallocate network for instance.
[  789.840103] env[65478]: DEBUG nova.policy [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6357bd2d70d94e5db2d957fa5ac989ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6c9b0fcb1f453a8108522a8924bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  789.886220] env[65478]: WARNING neutronclient.v2_0.client [req-f170fc94-655c-4d89-93b0-cef10c585626 req-d6c7d6b3-ad0b-4540-a8b6-f8e49480fcc0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  789.889952] env[65478]: DEBUG nova.network.neutron [-] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  789.929750] env[65478]: DEBUG oslo_vmware.api [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011669, 'name': CloneVM_Task} progress is 95%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  789.955883] env[65478]: DEBUG nova.network.neutron [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Updating instance_info_cache with network_info: [{"id": "9ccf1586-6b31-4e80-9174-a6868c4d116a", "address": "fa:16:3e:e5:ee:a0", "network": {"id": "e45f1f2f-7a0a-48b3-b75d-d13d6be57474", "bridge": "br-int", "label": "tempest-ServersAdminTestJSON-393396284-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "a8a09b6e5ab3418e871f2d26fcd10a07", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "3c92f34c-1dd7-4dc5-b8e8-f6c55cc5b4b8", "external-id": "nsx-vlan-transportzone-850", "segmentation_id": 850, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap9ccf1586-6b", "ovs_interfaceid": "9ccf1586-6b31-4e80-9174-a6868c4d116a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  789.960746] env[65478]: DEBUG oslo_vmware.api [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Task: {'id': task-6011671, 'name': ReconfigVM_Task, 'duration_secs': 0.498026} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  789.961371] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Reconfigured VM instance instance-00000018 to attach disk [datastore2] b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f/b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  789.963818] env[65478]: DEBUG oslo_vmware.service [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-a4bfbdc8-c353-4c24-9480-62779a0d0c93 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  789.972631] env[65478]: DEBUG oslo_vmware.api [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Waiting for the task: (returnval){
[  789.972631] env[65478]:    value = "task-6011672"
[  789.972631] env[65478]:    _type = "Task"
[  789.972631] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  789.981785] env[65478]: DEBUG oslo_vmware.api [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Task: {'id': task-6011672, 'name': Rename_Task} progress is 5%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  790.040809] env[65478]: WARNING neutronclient.v2_0.client [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  790.103271] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dd0394a4-15c6-426e-af99-4451d1dec393 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Lock "6ef7bbde-0ba8-44a9-8643-e674a14f3cbc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.302s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  790.145518] env[65478]: DEBUG nova.compute.manager [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  790.162889] env[65478]: DEBUG nova.network.neutron [-] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  790.322154] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  790.397227] env[65478]: INFO nova.compute.manager [-] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Took 1.97 seconds to deallocate network for instance.
[  790.432426] env[65478]: DEBUG oslo_vmware.api [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011669, 'name': CloneVM_Task, 'duration_secs': 1.699482} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  790.432638] env[65478]: INFO nova.virt.vmwareapi.vmops [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Created linked-clone VM from snapshot
[  790.433594] env[65478]: DEBUG oslo_vmware.service [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-59e7f69f-91c3-424e-abdd-eec370d273a8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  790.442701] env[65478]: DEBUG nova.virt.vmwareapi.images [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Uploading image a6a935cc-3e1e-4643-9e05-a2bf13ed4950 {{(pid=65478) upload_image_stream_optimized /opt/stack/nova/nova/virt/vmwareapi/images.py:441}}
[  790.457889] env[65478]: DEBUG nova.network.neutron [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Successfully created port: fc5c04e7-8dac-4f1f-a5e4-9f9d31498143 {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  790.463298] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Releasing lock "refresh_cache-c0545749-bc03-4f28-a0d4-ebaf55049095" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  790.466266] env[65478]: DEBUG nova.compute.manager [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Instance network_info: |[{"id": "9ccf1586-6b31-4e80-9174-a6868c4d116a", "address": "fa:16:3e:e5:ee:a0", "network": {"id": "e45f1f2f-7a0a-48b3-b75d-d13d6be57474", "bridge": "br-int", "label": "tempest-ServersAdminTestJSON-393396284-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "a8a09b6e5ab3418e871f2d26fcd10a07", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "3c92f34c-1dd7-4dc5-b8e8-f6c55cc5b4b8", "external-id": "nsx-vlan-transportzone-850", "segmentation_id": 850, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap9ccf1586-6b", "ovs_interfaceid": "9ccf1586-6b31-4e80-9174-a6868c4d116a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  790.467365] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:e5:ee:a0', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': '3c92f34c-1dd7-4dc5-b8e8-f6c55cc5b4b8', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': '9ccf1586-6b31-4e80-9174-a6868c4d116a', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  790.487349] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Destroying the VM {{(pid=65478) destroy_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1368}}
[  790.493242] env[65478]: DEBUG oslo_vmware.service [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking VirtualMachine.Destroy_Task with opID=oslo.vmware-150089fd-e07c-4f95-88af-9afdea4797dd {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  790.496328] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  790.499313] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  790.499755] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-2269c2eb-a7b1-40e1-a738-2336434d6f44 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  790.511072] env[65478]: DEBUG oslo_vmware.api [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Waiting for the task: (returnval){
[  790.511072] env[65478]:    value = "task-6011673"
[  790.511072] env[65478]:    _type = "Task"
[  790.511072] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  790.525729] env[65478]: DEBUG oslo_vmware.api [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Task: {'id': task-6011672, 'name': Rename_Task, 'duration_secs': 0.212348} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  790.526598] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  790.534237] env[65478]: DEBUG oslo_vmware.service [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-776ff88f-5c02-4ac6-9ab1-ef8eefc3c491 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  790.536398] env[65478]: DEBUG nova.network.neutron [req-f170fc94-655c-4d89-93b0-cef10c585626 req-d6c7d6b3-ad0b-4540-a8b6-f8e49480fcc0 service nova] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Updated VIF entry in instance network info cache for port 69013773-3f93-4432-9c5b-6726964a77d9. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  790.537965] env[65478]: DEBUG nova.network.neutron [req-f170fc94-655c-4d89-93b0-cef10c585626 req-d6c7d6b3-ad0b-4540-a8b6-f8e49480fcc0 service nova] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Updating instance_info_cache with network_info: [{"id": "69013773-3f93-4432-9c5b-6726964a77d9", "address": "fa:16:3e:b3:d3:36", "network": {"id": "66759086-f176-42e2-b3ef-a01d75ebc07f", "bridge": "br-int", "label": "tempest-InstanceActionsV221TestJSON-1441812429-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "48e9adbd728148138137b916a3d2fc1d", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "310b8ba9-edca-4135-863e-f4a786dd4a77", "external-id": "nsx-vlan-transportzone-768", "segmentation_id": 768, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap69013773-3f", "ovs_interfaceid": "69013773-3f93-4432-9c5b-6726964a77d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  790.544487] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  790.544487] env[65478]:    value = "task-6011674"
[  790.544487] env[65478]:    _type = "Task"
[  790.544487] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  790.554449] env[65478]: DEBUG oslo_vmware.api [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011673, 'name': Destroy_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  790.560336] env[65478]: DEBUG oslo_vmware.api [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Waiting for the task: (returnval){
[  790.560336] env[65478]:    value = "task-6011675"
[  790.560336] env[65478]:    _type = "Task"
[  790.560336] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  790.566439] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011674, 'name': CreateVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  790.571816] env[65478]: DEBUG oslo_vmware.api [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Task: {'id': task-6011675, 'name': PowerOnVM_Task} progress is 33%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  790.580294] env[65478]: DEBUG oslo_vmware.service [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-dda4882f-6c77-4492-972b-1cc2625b40f1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  790.589038] env[65478]: DEBUG oslo_vmware.service [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-2c7bd91b-873b-498b-a57a-230924029251 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  790.630166] env[65478]: DEBUG oslo_vmware.service [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c8e1decc-d4b8-49c3-894f-6537a8b1fb8f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  790.641058] env[65478]: DEBUG oslo_vmware.service [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d2698120-67d0-425a-8d90-a124abe8828f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  790.662880] env[65478]: DEBUG nova.compute.provider_tree [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  790.667566] env[65478]: INFO nova.compute.manager [-] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Took 2.02 seconds to deallocate network for instance.
[  790.893246] env[65478]: DEBUG nova.network.neutron [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Updated VIF entry in instance network info cache for port 5c9a8578-bb94-4d72-acef-25b60278df21. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  790.893664] env[65478]: DEBUG nova.network.neutron [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Updating instance_info_cache with network_info: [{"id": "5c9a8578-bb94-4d72-acef-25b60278df21", "address": "fa:16:3e:ae:3e:c3", "network": {"id": "f4cdd871-29d3-4e5f-9c28-ce69831a9d5b", "bridge": "br-int", "label": "tempest-FloatingIPsAssociationNegativeTestJSON-434449668-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "10.180.180.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "99bc07d4a2be4da3b5bb4900ea76450b", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "c68b7663-4f0e-47f0-ac7f-40c6d952f7bb", "external-id": "nsx-vlan-transportzone-696", "segmentation_id": 696, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap5c9a8578-bb", "ovs_interfaceid": "5c9a8578-bb94-4d72-acef-25b60278df21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  790.915521] env[65478]: DEBUG oslo_concurrency.lockutils [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  791.029628] env[65478]: DEBUG oslo_vmware.api [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011673, 'name': Destroy_Task} progress is 33%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  791.054864] env[65478]: DEBUG oslo_concurrency.lockutils [req-f170fc94-655c-4d89-93b0-cef10c585626 req-d6c7d6b3-ad0b-4540-a8b6-f8e49480fcc0 service nova] Releasing lock "refresh_cache-b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  791.063153] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011674, 'name': CreateVM_Task, 'duration_secs': 0.471545} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  791.067763] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  791.068525] env[65478]: WARNING neutronclient.v2_0.client [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  791.068910] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  791.069035] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquired lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  791.070081] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquired external semaphore "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  791.070081] env[65478]: DEBUG oslo_vmware.service [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-4d149814-40b9-474a-b47b-c3f3b8394308 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  791.076679] env[65478]: DEBUG oslo_vmware.api [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Task: {'id': task-6011675, 'name': PowerOnVM_Task} progress is 88%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  791.080257] env[65478]: DEBUG oslo_vmware.api [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[  791.080257] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c2a0f5-3ff5-c92a-21d6-931b6a7937d5"
[  791.080257] env[65478]:    _type = "Task"
[  791.080257] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  791.092779] env[65478]: DEBUG oslo_vmware.api [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c2a0f5-3ff5-c92a-21d6-931b6a7937d5, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  791.165950] env[65478]: DEBUG nova.compute.manager [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  791.174710] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  791.201779] env[65478]: DEBUG nova.virt.hardware [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  791.202174] env[65478]: DEBUG nova.virt.hardware [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  791.202412] env[65478]: DEBUG nova.virt.hardware [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  791.202673] env[65478]: DEBUG nova.virt.hardware [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  791.202863] env[65478]: DEBUG nova.virt.hardware [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  791.203056] env[65478]: DEBUG nova.virt.hardware [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  791.203417] env[65478]: DEBUG nova.virt.hardware [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  791.203604] env[65478]: DEBUG nova.virt.hardware [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  791.204430] env[65478]: DEBUG nova.virt.hardware [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  791.204927] env[65478]: DEBUG nova.scheduler.client.report [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Updated inventory for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with generation 33 in Placement from set_inventory_for_provider using data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}}
[  791.205276] env[65478]: DEBUG nova.virt.hardware [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  791.205566] env[65478]: DEBUG nova.compute.provider_tree [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Updating resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 generation from 33 to 34 during operation: update_inventory {{(pid=65478) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
[  791.205868] env[65478]: DEBUG nova.virt.hardware [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  791.207362] env[65478]: DEBUG nova.compute.provider_tree [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  791.210608] env[65478]: DEBUG oslo_vmware.service [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c897f2d4-bb14-4b8d-9b06-650e20c90fce {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  791.225579] env[65478]: DEBUG oslo_vmware.service [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c6bba2f0-b6fb-4fb2-a6ec-2abfcba3519b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  791.396655] env[65478]: DEBUG oslo_concurrency.lockutils [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] Releasing lock "refresh_cache-eb076624-c76c-47da-9320-5fc13a51b365" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  791.396886] env[65478]: DEBUG nova.compute.manager [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Received event network-changed-958d3060-f044-4655-8c5e-bd81773ad096 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  791.397024] env[65478]: DEBUG nova.compute.manager [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Refreshing instance network info cache due to event network-changed-958d3060-f044-4655-8c5e-bd81773ad096. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  791.397247] env[65478]: DEBUG oslo_concurrency.lockutils [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] Acquiring lock "refresh_cache-88cd130c-b811-4789-aea2-964848abdd69" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  791.397344] env[65478]: DEBUG oslo_concurrency.lockutils [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] Acquired lock "refresh_cache-88cd130c-b811-4789-aea2-964848abdd69" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  791.397467] env[65478]: DEBUG nova.network.neutron [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Refreshing network info cache for port 958d3060-f044-4655-8c5e-bd81773ad096 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  791.527839] env[65478]: DEBUG oslo_vmware.api [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011673, 'name': Destroy_Task, 'duration_secs': 0.60349} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  791.528141] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Destroyed the VM
[  791.528428] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Deleting Snapshot of the VM instance {{(pid=65478) _delete_vm_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:932}}
[  791.528686] env[65478]: DEBUG oslo_vmware.service [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking VirtualMachineSnapshot.RemoveSnapshot_Task with opID=oslo.vmware-7246e9c7-eea3-4020-8293-4b8018e68ffc {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  791.535449] env[65478]: DEBUG oslo_vmware.api [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Waiting for the task: (returnval){
[  791.535449] env[65478]:    value = "task-6011676"
[  791.535449] env[65478]:    _type = "Task"
[  791.535449] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  791.544305] env[65478]: DEBUG oslo_vmware.api [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011676, 'name': RemoveSnapshot_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  791.575191] env[65478]: DEBUG oslo_vmware.api [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Task: {'id': task-6011675, 'name': PowerOnVM_Task, 'duration_secs': 0.694014} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  791.575474] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  791.575722] env[65478]: INFO nova.compute.manager [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Took 9.04 seconds to spawn the instance on the hypervisor.
[  791.575888] env[65478]: DEBUG nova.compute.manager [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  791.576984] env[65478]: DEBUG oslo_vmware.service [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3752f9d7-7f60-427c-8394-5ca019315bb4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  791.602091] env[65478]: DEBUG oslo_vmware.api [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c2a0f5-3ff5-c92a-21d6-931b6a7937d5, 'name': SearchDatastore_Task, 'duration_secs': 0.00888} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  791.602091] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Releasing lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  791.602648] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  791.603360] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  791.603819] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquired lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  791.606452] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Creating directory with path [datastore2] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  791.606452] env[65478]: DEBUG oslo_vmware.service [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-cdb9414d-6370-4995-bf56-a7ec341ed973 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  791.615820] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Created directory with path [datastore2] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  791.616489] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Folder [datastore2] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  791.618232] env[65478]: DEBUG oslo_vmware.service [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-564329c2-549c-4572-85cb-f7042240c965 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  791.627592] env[65478]: DEBUG oslo_vmware.api [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[  791.627592] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]525c7d3c-aaae-3319-1b0b-a26ec3e8e3af"
[  791.627592] env[65478]:    _type = "Task"
[  791.627592] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  791.639600] env[65478]: DEBUG oslo_vmware.api [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]525c7d3c-aaae-3319-1b0b-a26ec3e8e3af, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  791.713311] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.600s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  791.714241] env[65478]: DEBUG nova.compute.manager [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  791.718758] env[65478]: DEBUG oslo_concurrency.lockutils [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 9.814s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  791.719862] env[65478]: DEBUG nova.objects.instance [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] [instance: 95525483-b7db-427e-87b5-3f946972a250] Trying to apply a migration context that does not seem to be set for this instance {{(pid=65478) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
[  791.901183] env[65478]: WARNING neutronclient.v2_0.client [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  792.045382] env[65478]: DEBUG oslo_vmware.api [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011676, 'name': RemoveSnapshot_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  792.114347] env[65478]: INFO nova.compute.manager [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Took 18.87 seconds to build instance.
[  792.142501] env[65478]: DEBUG oslo_vmware.api [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]525c7d3c-aaae-3319-1b0b-a26ec3e8e3af, 'name': SearchDatastore_Task, 'duration_secs': 0.014326} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  792.142501] env[65478]: DEBUG oslo_vmware.service [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-969ea3ef-5274-450c-bc61-83ae875c566b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  792.150317] env[65478]: DEBUG oslo_vmware.api [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[  792.150317] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]522f34b4-f546-6643-a4f5-49603293b914"
[  792.150317] env[65478]:    _type = "Task"
[  792.150317] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  792.160479] env[65478]: DEBUG oslo_vmware.api [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]522f34b4-f546-6643-a4f5-49603293b914, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  792.225494] env[65478]: DEBUG nova.compute.utils [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  792.226803] env[65478]: DEBUG nova.compute.manager [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  792.232294] env[65478]: DEBUG nova.network.neutron [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  792.232294] env[65478]: WARNING neutronclient.v2_0.client [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  792.232294] env[65478]: WARNING neutronclient.v2_0.client [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  792.296304] env[65478]: DEBUG nova.network.neutron [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Successfully updated port: fc5c04e7-8dac-4f1f-a5e4-9f9d31498143 {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  792.401541] env[65478]: DEBUG nova.network.neutron [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  792.441968] env[65478]: DEBUG nova.policy [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a8d3abe30fcf48d49d0a10fbb8fa2edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85e7e15986e4e379de765011083021f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  792.546859] env[65478]: DEBUG oslo_vmware.api [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011676, 'name': RemoveSnapshot_Task, 'duration_secs': 0.641907} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  792.546859] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Deleted Snapshot of the VM instance {{(pid=65478) _delete_vm_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:938}}
[  792.617773] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a7659aac-f172-4cf6-8f1a-58e567a7d1db tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Lock "b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.383s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  792.652232] env[65478]: DEBUG nova.network.neutron [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  792.672358] env[65478]: DEBUG oslo_vmware.api [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]522f34b4-f546-6643-a4f5-49603293b914, 'name': SearchDatastore_Task, 'duration_secs': 0.009902} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  792.672358] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Releasing lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  792.672358] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Copying Virtual Disk [datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore2] c0545749-bc03-4f28-a0d4-ebaf55049095/c0545749-bc03-4f28-a0d4-ebaf55049095.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  792.672358] env[65478]: DEBUG oslo_vmware.service [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-f2ae8572-3e19-4f10-956f-f08bc565fd8c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  792.681051] env[65478]: DEBUG oslo_vmware.api [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[  792.681051] env[65478]:    value = "task-6011677"
[  792.681051] env[65478]:    _type = "Task"
[  792.681051] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  792.694630] env[65478]: DEBUG oslo_vmware.api [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011677, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  792.736614] env[65478]: DEBUG nova.compute.manager [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  792.740943] env[65478]: DEBUG oslo_concurrency.lockutils [None req-99221a6e-ebea-46d8-a140-acfa282459a9 tempest-ServersAdmin275Test-625248688 tempest-ServersAdmin275Test-625248688-project-admin] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.023s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  792.745869] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 7.194s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  792.749020] env[65478]: DEBUG nova.objects.instance [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Lazy-loading 'resources' on Instance uuid f01c577a-3995-465a-98ae-21880df54cc0 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  792.798729] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Acquiring lock "refresh_cache-9b286a00-af27-4012-a596-45bbe98da254" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  792.798729] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Acquired lock "refresh_cache-9b286a00-af27-4012-a596-45bbe98da254" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  792.798729] env[65478]: DEBUG nova.network.neutron [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  793.049612] env[65478]: DEBUG nova.network.neutron [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Successfully created port: fb55a6bb-2879-44ea-b228-fe4609c36e10 {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  793.056295] env[65478]: WARNING nova.compute.manager [None req-47106f9d-4e6d-4e2c-aec3-9fc64ddd93de tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Image not found during snapshot: nova.exception.ImageNotFound: Image a6a935cc-3e1e-4643-9e05-a2bf13ed4950 could not be found.
[  793.160870] env[65478]: DEBUG oslo_concurrency.lockutils [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] Releasing lock "refresh_cache-88cd130c-b811-4789-aea2-964848abdd69" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  793.161118] env[65478]: DEBUG nova.compute.manager [req-47d5a3f0-d4c2-4198-8454-d963b97fc612 req-3de85f3f-da85-4577-ac57-2abad15f4d65 service nova] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Received event network-vif-deleted-b7d6d7e2-7876-4997-af0e-f826ba3ca090 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  793.193606] env[65478]: DEBUG oslo_vmware.api [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011677, 'name': CopyVirtualDisk_Task} progress is 51%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  793.474268] env[65478]: DEBUG nova.network.neutron [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  793.642181] env[65478]: DEBUG oslo_vmware.service [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-24fcfc31-e158-4dc6-9e60-615cc678e3f2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  793.649508] env[65478]: DEBUG oslo_vmware.service [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1259d7f7-9c05-4405-b57c-55db3af21888 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  793.683967] env[65478]: DEBUG oslo_vmware.service [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-fff65283-7854-432d-ba93-670233a7d1e9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  793.697549] env[65478]: DEBUG oslo_vmware.service [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-57f6f6ee-9c88-474d-8a12-dd724099cfb6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  793.704996] env[65478]: DEBUG oslo_vmware.api [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011677, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.588396} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  793.705978] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Copied Virtual Disk [datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore2] c0545749-bc03-4f28-a0d4-ebaf55049095/c0545749-bc03-4f28-a0d4-ebaf55049095.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  793.705978] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  793.705978] env[65478]: DEBUG oslo_vmware.service [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-e4381447-b5ae-4cf1-ba4b-30cccae135bb {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  793.718459] env[65478]: DEBUG nova.compute.provider_tree [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  793.721966] env[65478]: DEBUG oslo_vmware.api [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[  793.721966] env[65478]:    value = "task-6011678"
[  793.721966] env[65478]:    _type = "Task"
[  793.721966] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  793.733478] env[65478]: DEBUG oslo_vmware.api [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011678, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  793.756929] env[65478]: DEBUG nova.compute.manager [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  793.785896] env[65478]: DEBUG nova.virt.hardware [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  793.786120] env[65478]: DEBUG nova.virt.hardware [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  793.786238] env[65478]: DEBUG nova.virt.hardware [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  793.786379] env[65478]: DEBUG nova.virt.hardware [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  793.786519] env[65478]: DEBUG nova.virt.hardware [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  793.786582] env[65478]: DEBUG nova.virt.hardware [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  793.786939] env[65478]: DEBUG nova.virt.hardware [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  793.786939] env[65478]: DEBUG nova.virt.hardware [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  793.787030] env[65478]: DEBUG nova.virt.hardware [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  793.787249] env[65478]: DEBUG nova.virt.hardware [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  793.787442] env[65478]: DEBUG nova.virt.hardware [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  793.788528] env[65478]: DEBUG oslo_vmware.service [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-49b9cf68-c0be-464f-94a1-c828814d3780 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  793.796783] env[65478]: DEBUG oslo_vmware.service [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0aee1227-ed4d-48c4-a379-b443ff8e7242 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  794.234896] env[65478]: DEBUG oslo_vmware.api [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011678, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.061478} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  794.235125] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  794.236619] env[65478]: DEBUG oslo_vmware.service [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-31e02503-da0e-4481-bb10-e461bba483a7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  794.260681] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Reconfiguring VM instance instance-00000019 to attach disk [datastore2] c0545749-bc03-4f28-a0d4-ebaf55049095/c0545749-bc03-4f28-a0d4-ebaf55049095.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  794.261400] env[65478]: DEBUG oslo_vmware.service [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-be54b994-bd61-4230-8fbb-746c5a4ae029 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  794.267654] env[65478]: DEBUG nova.scheduler.client.report [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Updated inventory for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with generation 34 in Placement from set_inventory_for_provider using data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}}
[  794.273065] env[65478]: DEBUG nova.compute.provider_tree [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Updating resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 generation from 34 to 35 during operation: update_inventory {{(pid=65478) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
[  794.278853] env[65478]: DEBUG nova.compute.provider_tree [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  794.285377] env[65478]: DEBUG oslo_vmware.api [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[  794.285377] env[65478]:    value = "task-6011679"
[  794.285377] env[65478]:    _type = "Task"
[  794.285377] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  794.293606] env[65478]: DEBUG oslo_vmware.api [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011679, 'name': ReconfigVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  794.791177] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.045s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  794.797523] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 8.206s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  794.799482] env[65478]: DEBUG oslo_vmware.api [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011679, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  794.805251] env[65478]: WARNING neutronclient.v2_0.client [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  794.829691] env[65478]: INFO nova.scheduler.client.report [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Deleted allocations for instance f01c577a-3995-465a-98ae-21880df54cc0
[  794.912219] env[65478]: DEBUG nova.compute.manager [req-bbd8b354-ef59-429b-9ca8-a43c93d554a8 req-7deb323a-be19-4e4d-87e7-87c89eb49c2e service nova] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Received event network-vif-plugged-9ccf1586-6b31-4e80-9174-a6868c4d116a {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  794.914708] env[65478]: DEBUG oslo_concurrency.lockutils [req-bbd8b354-ef59-429b-9ca8-a43c93d554a8 req-7deb323a-be19-4e4d-87e7-87c89eb49c2e service nova] Acquiring lock "c0545749-bc03-4f28-a0d4-ebaf55049095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  794.914708] env[65478]: DEBUG oslo_concurrency.lockutils [req-bbd8b354-ef59-429b-9ca8-a43c93d554a8 req-7deb323a-be19-4e4d-87e7-87c89eb49c2e service nova] Lock "c0545749-bc03-4f28-a0d4-ebaf55049095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  794.914708] env[65478]: DEBUG oslo_concurrency.lockutils [req-bbd8b354-ef59-429b-9ca8-a43c93d554a8 req-7deb323a-be19-4e4d-87e7-87c89eb49c2e service nova] Lock "c0545749-bc03-4f28-a0d4-ebaf55049095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  794.914708] env[65478]: DEBUG nova.compute.manager [req-bbd8b354-ef59-429b-9ca8-a43c93d554a8 req-7deb323a-be19-4e4d-87e7-87c89eb49c2e service nova] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] No waiting events found dispatching network-vif-plugged-9ccf1586-6b31-4e80-9174-a6868c4d116a {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  794.914708] env[65478]: WARNING nova.compute.manager [req-bbd8b354-ef59-429b-9ca8-a43c93d554a8 req-7deb323a-be19-4e4d-87e7-87c89eb49c2e service nova] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Received unexpected event network-vif-plugged-9ccf1586-6b31-4e80-9174-a6868c4d116a for instance with vm_state building and task_state spawning.
[  794.914983] env[65478]: DEBUG nova.compute.manager [req-bbd8b354-ef59-429b-9ca8-a43c93d554a8 req-7deb323a-be19-4e4d-87e7-87c89eb49c2e service nova] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Received event network-changed-9ccf1586-6b31-4e80-9174-a6868c4d116a {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  794.914983] env[65478]: DEBUG nova.compute.manager [req-bbd8b354-ef59-429b-9ca8-a43c93d554a8 req-7deb323a-be19-4e4d-87e7-87c89eb49c2e service nova] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Refreshing instance network info cache due to event network-changed-9ccf1586-6b31-4e80-9174-a6868c4d116a. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  794.914983] env[65478]: DEBUG oslo_concurrency.lockutils [req-bbd8b354-ef59-429b-9ca8-a43c93d554a8 req-7deb323a-be19-4e4d-87e7-87c89eb49c2e service nova] Acquiring lock "refresh_cache-c0545749-bc03-4f28-a0d4-ebaf55049095" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  794.914983] env[65478]: DEBUG oslo_concurrency.lockutils [req-bbd8b354-ef59-429b-9ca8-a43c93d554a8 req-7deb323a-be19-4e4d-87e7-87c89eb49c2e service nova] Acquired lock "refresh_cache-c0545749-bc03-4f28-a0d4-ebaf55049095" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  794.914983] env[65478]: DEBUG nova.network.neutron [req-bbd8b354-ef59-429b-9ca8-a43c93d554a8 req-7deb323a-be19-4e4d-87e7-87c89eb49c2e service nova] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Refreshing network info cache for port 9ccf1586-6b31-4e80-9174-a6868c4d116a {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  794.920747] env[65478]: DEBUG nova.network.neutron [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Successfully updated port: fb55a6bb-2879-44ea-b228-fe4609c36e10 {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  795.060423] env[65478]: DEBUG nova.network.neutron [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Updating instance_info_cache with network_info: [{"id": "fc5c04e7-8dac-4f1f-a5e4-9f9d31498143", "address": "fa:16:3e:17:84:6e", "network": {"id": "7cd93ed0-202b-4b24-a579-dd5eacc8ea60", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140861423-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c6c9b0fcb1f453a8108522a8924bda3", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "d4345ef6-a7c8-4c1c-badf-a0d4f578b61c", "external-id": "nsx-vlan-transportzone-677", "segmentation_id": 677, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapfc5c04e7-8d", "ovs_interfaceid": "fc5c04e7-8dac-4f1f-a5e4-9f9d31498143", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  795.299786] env[65478]: DEBUG oslo_vmware.api [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011679, 'name': ReconfigVM_Task, 'duration_secs': 0.984927} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  795.301015] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Reconfigured VM instance instance-00000019 to attach disk [datastore2] c0545749-bc03-4f28-a0d4-ebaf55049095/c0545749-bc03-4f28-a0d4-ebaf55049095.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  795.301015] env[65478]: DEBUG oslo_vmware.service [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-06d8ee26-c5ea-4e66-b31b-6ae23e8119e8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  795.307408] env[65478]: DEBUG oslo_vmware.api [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[  795.307408] env[65478]:    value = "task-6011680"
[  795.307408] env[65478]:    _type = "Task"
[  795.307408] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  795.332786] env[65478]: DEBUG oslo_vmware.api [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011680, 'name': Rename_Task} progress is 10%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  795.341178] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4701e196-8cbe-49fd-9944-fe22f057bf5b tempest-ImagesNegativeTestJSON-579312141 tempest-ImagesNegativeTestJSON-579312141-project-member] Lock "f01c577a-3995-465a-98ae-21880df54cc0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.341s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  795.386339] env[65478]: DEBUG nova.compute.manager [req-621ad045-dd22-480c-8e12-28fba7c3aa48 req-35a13334-baab-443e-a498-6c129f6b883f service nova] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Received event network-changed-a4636485-7b6f-4fbb-ab94-d4f75ada7a1c {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  795.388192] env[65478]: DEBUG nova.compute.manager [req-621ad045-dd22-480c-8e12-28fba7c3aa48 req-35a13334-baab-443e-a498-6c129f6b883f service nova] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Refreshing instance network info cache due to event network-changed-a4636485-7b6f-4fbb-ab94-d4f75ada7a1c. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  795.388397] env[65478]: DEBUG oslo_concurrency.lockutils [req-621ad045-dd22-480c-8e12-28fba7c3aa48 req-35a13334-baab-443e-a498-6c129f6b883f service nova] Acquiring lock "refresh_cache-d978e71d-2c30-4a76-b000-6ddf3203ab10" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  795.388588] env[65478]: DEBUG oslo_concurrency.lockutils [req-621ad045-dd22-480c-8e12-28fba7c3aa48 req-35a13334-baab-443e-a498-6c129f6b883f service nova] Acquired lock "refresh_cache-d978e71d-2c30-4a76-b000-6ddf3203ab10" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  795.388632] env[65478]: DEBUG nova.network.neutron [req-621ad045-dd22-480c-8e12-28fba7c3aa48 req-35a13334-baab-443e-a498-6c129f6b883f service nova] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Refreshing network info cache for port a4636485-7b6f-4fbb-ab94-d4f75ada7a1c {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  795.430217] env[65478]: WARNING neutronclient.v2_0.client [req-bbd8b354-ef59-429b-9ca8-a43c93d554a8 req-7deb323a-be19-4e4d-87e7-87c89eb49c2e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  795.432723] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Acquiring lock "refresh_cache-f0e88cef-300d-42a4-9cb6-843dc85da6a3" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  795.432723] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Acquired lock "refresh_cache-f0e88cef-300d-42a4-9cb6-843dc85da6a3" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  795.435198] env[65478]: DEBUG nova.network.neutron [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  795.566044] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Releasing lock "refresh_cache-9b286a00-af27-4012-a596-45bbe98da254" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  795.566044] env[65478]: DEBUG nova.compute.manager [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Instance network_info: |[{"id": "fc5c04e7-8dac-4f1f-a5e4-9f9d31498143", "address": "fa:16:3e:17:84:6e", "network": {"id": "7cd93ed0-202b-4b24-a579-dd5eacc8ea60", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140861423-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c6c9b0fcb1f453a8108522a8924bda3", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "d4345ef6-a7c8-4c1c-badf-a0d4f578b61c", "external-id": "nsx-vlan-transportzone-677", "segmentation_id": 677, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapfc5c04e7-8d", "ovs_interfaceid": "fc5c04e7-8dac-4f1f-a5e4-9f9d31498143", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  795.566177] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:17:84:6e', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': 'd4345ef6-a7c8-4c1c-badf-a0d4f578b61c', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': 'fc5c04e7-8dac-4f1f-a5e4-9f9d31498143', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  795.578932] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Creating folder: Project (3c6c9b0fcb1f453a8108522a8924bda3). Parent ref: group-v1161186. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  795.579761] env[65478]: DEBUG oslo_vmware.service [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-4a129490-f596-4472-a2d4-2a927ff1ec1a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  795.591202] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Created folder: Project (3c6c9b0fcb1f453a8108522a8924bda3) in parent group-v1161186.
[  795.591202] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Creating folder: Instances. Parent ref: group-v1161260. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  795.591202] env[65478]: DEBUG oslo_vmware.service [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-773c4f4f-5af1-45e6-b260-81190cd27351 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  795.601427] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Created folder: Instances in parent group-v1161260.
[  795.602067] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  795.602368] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  795.602691] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-4cd6cd4f-2bd9-48f6-9a74-b99d58baea4f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  795.624110] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  795.624110] env[65478]:    value = "task-6011683"
[  795.624110] env[65478]:    _type = "Task"
[  795.624110] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  795.631893] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011683, 'name': CreateVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  795.793081] env[65478]: WARNING neutronclient.v2_0.client [req-bbd8b354-ef59-429b-9ca8-a43c93d554a8 req-7deb323a-be19-4e4d-87e7-87c89eb49c2e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  795.821037] env[65478]: DEBUG oslo_vmware.api [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011680, 'name': Rename_Task, 'duration_secs': 0.243312} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  795.822171] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  795.822428] env[65478]: DEBUG oslo_vmware.service [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-c081b2b2-2906-4cec-a78b-42f91d89936a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  795.829246] env[65478]: DEBUG oslo_vmware.api [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[  795.829246] env[65478]:    value = "task-6011684"
[  795.829246] env[65478]:    _type = "Task"
[  795.829246] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  795.841726] env[65478]: DEBUG oslo_vmware.api [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011684, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  795.867842] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance caf7856c-4e51-4e6c-ad32-2088e15d5d8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  795.867842] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 230cc05f-433e-4510-947f-35466335662d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  795.868137] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 78246782-d2a2-4819-8924-51764ffe05aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  795.868336] env[65478]: WARNING nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 95525483-b7db-427e-87b5-3f946972a250 is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do.
[  795.868485] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 98b2d40a-0c59-4540-b60e-17e5206dea42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  795.868688] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e4810749-aefd-411e-87c1-5b1b1967538f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  795.868840] env[65478]: WARNING nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 88cd130c-b811-4789-aea2-964848abdd69 is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do.
[  795.868840] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 4f7fb80a-cb05-4bd5-bb10-380d95b2e892 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  795.868975] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance eb466e5e-a499-4856-9c12-c7ca87b53230 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  795.869135] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance eb076624-c76c-47da-9320-5fc13a51b365 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  795.869206] env[65478]: WARNING nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 788343e6-5c24-4e9b-9c74-e14f3b179cdb is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do.
[  795.869265] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 4821048b-4b5a-40b5-8888-f00dd28425d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  795.869397] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d978e71d-2c30-4a76-b000-6ddf3203ab10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  795.869461] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance db37d828-c474-4577-816b-6fb2fcd9a82b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  795.869584] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  795.869669] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  795.869896] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  795.869896] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance c0545749-bc03-4f28-a0d4-ebaf55049095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  795.870058] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 9b286a00-af27-4012-a596-45bbe98da254 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  795.870058] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance f0e88cef-300d-42a4-9cb6-843dc85da6a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  795.870280] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 17 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[  795.870422] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=3776MB phys_disk=100GB used_disk=17GB total_vcpus=48 used_vcpus=17 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '17', 'num_vm_active': '14', 'num_task_None': '14', 'num_os_type_None': '17', 'num_proj_7dd8c4cd35c44466b1991950f28d886b': '1', 'io_workload': '3', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_81a0ae95d73f4678b203b7db9a0d36a7': '1', 'num_proj_183f1111bd4a4c13a354835aa7266cc2': '1', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '1', 'num_proj_70efc035843c47d69ec6a42f446a2b91': '1', 'num_proj_4d4c6f3c8d4a40f68deffc1fd31d86ba': '1', 'num_proj_99bc07d4a2be4da3b5bb4900ea76450b': '1', 'num_proj_60c31211e0004fe78fab62e554754271': '1', 'num_proj_1f872aa3128c4866aed16d152b15486f': '1', 'num_proj_a8a09b6e5ab3418e871f2d26fcd10a07': '2', 'num_proj_83694f1109504372b48f086ead1a8991': '1', 'num_proj_8de0dd2b26b24b4fb6e13f475974035a': '1', 'num_proj_48e9adbd728148138137b916a3d2fc1d': '1', 'num_vm_building': '3', 'num_task_spawning': '3', 'num_proj_3c6c9b0fcb1f453a8108522a8924bda3': '1', 'num_proj_c85e7e15986e4e379de765011083021f': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[  795.896060] env[65478]: WARNING neutronclient.v2_0.client [req-621ad045-dd22-480c-8e12-28fba7c3aa48 req-35a13334-baab-443e-a498-6c129f6b883f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  796.065799] env[65478]: DEBUG nova.network.neutron [req-bbd8b354-ef59-429b-9ca8-a43c93d554a8 req-7deb323a-be19-4e4d-87e7-87c89eb49c2e service nova] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Updated VIF entry in instance network info cache for port 9ccf1586-6b31-4e80-9174-a6868c4d116a. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  796.066411] env[65478]: DEBUG nova.network.neutron [req-bbd8b354-ef59-429b-9ca8-a43c93d554a8 req-7deb323a-be19-4e4d-87e7-87c89eb49c2e service nova] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Updating instance_info_cache with network_info: [{"id": "9ccf1586-6b31-4e80-9174-a6868c4d116a", "address": "fa:16:3e:e5:ee:a0", "network": {"id": "e45f1f2f-7a0a-48b3-b75d-d13d6be57474", "bridge": "br-int", "label": "tempest-ServersAdminTestJSON-393396284-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "a8a09b6e5ab3418e871f2d26fcd10a07", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "3c92f34c-1dd7-4dc5-b8e8-f6c55cc5b4b8", "external-id": "nsx-vlan-transportzone-850", "segmentation_id": 850, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap9ccf1586-6b", "ovs_interfaceid": "9ccf1586-6b31-4e80-9174-a6868c4d116a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  796.139443] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011683, 'name': CreateVM_Task, 'duration_secs': 0.472866} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  796.139589] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  796.140256] env[65478]: WARNING neutronclient.v2_0.client [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  796.140643] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Acquiring lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  796.140794] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Acquired lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  796.142381] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Acquired external semaphore "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  796.142679] env[65478]: DEBUG oslo_vmware.service [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-567992e6-f6db-407f-a0dd-844ba997c103 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  796.151932] env[65478]: DEBUG oslo_vmware.api [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  796.151932] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]5293e2bf-2f39-2f24-e2d3-ef0763cee66e"
[  796.151932] env[65478]:    _type = "Task"
[  796.151932] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  796.164155] env[65478]: DEBUG oslo_vmware.api [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5293e2bf-2f39-2f24-e2d3-ef0763cee66e, 'name': SearchDatastore_Task, 'duration_secs': 0.00958} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  796.167377] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Releasing lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  796.167614] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  796.168705] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Acquiring lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  796.168705] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Acquired lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  796.168705] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Creating directory with path [datastore2] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  796.168705] env[65478]: DEBUG oslo_vmware.service [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-41f0b28a-0ea6-4aa0-8122-6704397782ae {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  796.175846] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Created directory with path [datastore2] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  796.175934] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Folder [datastore2] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  796.176876] env[65478]: DEBUG oslo_vmware.service [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-308f8176-79eb-4386-baaa-fcb873db95ae {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  796.180486] env[65478]: DEBUG nova.network.neutron [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  796.184894] env[65478]: DEBUG oslo_vmware.api [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  796.184894] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]525f7cd8-ad9b-aae8-34e1-065f76dbecbb"
[  796.184894] env[65478]:    _type = "Task"
[  796.184894] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  796.194308] env[65478]: DEBUG oslo_vmware.api [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]525f7cd8-ad9b-aae8-34e1-065f76dbecbb, 'name': SearchDatastore_Task, 'duration_secs': 0.007834} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  796.195075] env[65478]: DEBUG oslo_vmware.service [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-689a462c-2aca-4907-a7bf-e87f01355d6a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  796.199928] env[65478]: DEBUG oslo_vmware.api [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  796.199928] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]5273d755-1a0a-1cbc-097e-842eee76e3d3"
[  796.199928] env[65478]:    _type = "Task"
[  796.199928] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  796.211152] env[65478]: DEBUG oslo_vmware.api [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5273d755-1a0a-1cbc-097e-842eee76e3d3, 'name': SearchDatastore_Task, 'duration_secs': 0.007873} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  796.211366] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Releasing lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  796.212157] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Copying Virtual Disk [datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore2] 9b286a00-af27-4012-a596-45bbe98da254/9b286a00-af27-4012-a596-45bbe98da254.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  796.212157] env[65478]: DEBUG oslo_vmware.service [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-0a5f014f-6d72-40ce-b41c-478931abdee0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  796.220548] env[65478]: DEBUG oslo_vmware.api [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  796.220548] env[65478]:    value = "task-6011685"
[  796.220548] env[65478]:    _type = "Task"
[  796.220548] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  796.231043] env[65478]: DEBUG oslo_vmware.api [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011685, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  796.233175] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1a8a4465-a2be-46d3-b241-c5722423003d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  796.240124] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-714a0f87-cf60-4d78-b28b-d04d57e69c5c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  796.276399] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-392fb9bd-8481-4777-980f-290eb83d8a4d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  796.285801] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-116047b7-35a8-4553-bdd4-37486d0cb7b9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  796.306478] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  796.341627] env[65478]: DEBUG oslo_vmware.api [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011684, 'name': PowerOnVM_Task} progress is 100%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  796.568623] env[65478]: DEBUG oslo_concurrency.lockutils [req-bbd8b354-ef59-429b-9ca8-a43c93d554a8 req-7deb323a-be19-4e4d-87e7-87c89eb49c2e service nova] Releasing lock "refresh_cache-c0545749-bc03-4f28-a0d4-ebaf55049095" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  796.733035] env[65478]: DEBUG oslo_vmware.api [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011685, 'name': CopyVirtualDisk_Task} progress is 4%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  796.814031] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  796.840461] env[65478]: DEBUG oslo_vmware.api [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011684, 'name': PowerOnVM_Task, 'duration_secs': 0.53468} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  796.840732] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  796.840921] env[65478]: INFO nova.compute.manager [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Took 10.49 seconds to spawn the instance on the hypervisor.
[  796.841075] env[65478]: DEBUG nova.compute.manager [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  796.842189] env[65478]: DEBUG oslo_vmware.service [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ad22c5d6-470c-4a45-bcde-93c9c8dd56cc {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  797.179177] env[65478]: WARNING neutronclient.v2_0.client [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  797.211791] env[65478]: WARNING neutronclient.v2_0.client [req-621ad045-dd22-480c-8e12-28fba7c3aa48 req-35a13334-baab-443e-a498-6c129f6b883f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  797.234312] env[65478]: DEBUG oslo_vmware.api [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011685, 'name': CopyVirtualDisk_Task} progress is 100%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  797.319692] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[  797.319896] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.528s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  797.320260] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 43.46 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[  797.320535] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 6.999s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  797.320725] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  797.322133] env[65478]: DEBUG oslo_concurrency.lockutils [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 6.406s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  797.323179] env[65478]: DEBUG oslo_concurrency.lockutils [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  797.326703] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 6.152s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  797.328089] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  797.361810] env[65478]: INFO nova.compute.manager [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Took 20.64 seconds to build instance.
[  797.371190] env[65478]: INFO nova.scheduler.client.report [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Deleted allocations for instance 88cd130c-b811-4789-aea2-964848abdd69
[  797.384026] env[65478]: INFO nova.scheduler.client.report [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Deleted allocations for instance 95525483-b7db-427e-87b5-3f946972a250
[  797.391218] env[65478]: INFO nova.scheduler.client.report [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Deleted allocations for instance 788343e6-5c24-4e9b-9c74-e14f3b179cdb
[  797.449551] env[65478]: DEBUG nova.network.neutron [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Updating instance_info_cache with network_info: [{"id": "fb55a6bb-2879-44ea-b228-fe4609c36e10", "address": "fa:16:3e:20:00:e4", "network": {"id": "a0fc71cb-b2b3-4c49-84f4-a690fb3e140e", "bridge": "br-int", "label": "tempest-ServersTestJSON-389312898-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c85e7e15986e4e379de765011083021f", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "dacd109c-2442-41b8-b612-7ed3efbdaa94", "external-id": "nsx-vlan-transportzone-940", "segmentation_id": 940, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapfb55a6bb-28", "ovs_interfaceid": "fb55a6bb-2879-44ea-b228-fe4609c36e10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  797.483836] env[65478]: DEBUG nova.network.neutron [req-621ad045-dd22-480c-8e12-28fba7c3aa48 req-35a13334-baab-443e-a498-6c129f6b883f service nova] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Updated VIF entry in instance network info cache for port a4636485-7b6f-4fbb-ab94-d4f75ada7a1c. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  797.484154] env[65478]: DEBUG nova.network.neutron [req-621ad045-dd22-480c-8e12-28fba7c3aa48 req-35a13334-baab-443e-a498-6c129f6b883f service nova] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Updating instance_info_cache with network_info: [{"id": "a4636485-7b6f-4fbb-ab94-d4f75ada7a1c", "address": "fa:16:3e:bc:0f:ab", "network": {"id": "432219d2-eada-4b7b-82da-1951de930922", "bridge": "br-int", "label": "tempest-AttachInterfacesUnderV243Test-1661348426-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "10.180.180.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "1f872aa3128c4866aed16d152b15486f", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "8b1a0b17-d008-4a8b-be2a-796ff1a9a2d1", "external-id": "nsx-vlan-transportzone-880", "segmentation_id": 880, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapa4636485-7b", "ovs_interfaceid": "a4636485-7b6f-4fbb-ab94-d4f75ada7a1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  797.732913] env[65478]: DEBUG oslo_vmware.api [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011685, 'name': CopyVirtualDisk_Task} progress is 100%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  797.865694] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6b0b7fe6-d75e-46b8-9722-3a117b58eeca tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "c0545749-bc03-4f28-a0d4-ebaf55049095" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.169s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  797.881907] env[65478]: DEBUG oslo_concurrency.lockutils [None req-970b7ceb-b814-4666-a5cc-16eeb40900e1 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Lock "88cd130c-b811-4789-aea2-964848abdd69" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.276s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  797.896635] env[65478]: DEBUG oslo_concurrency.lockutils [None req-6d5bdd95-d08b-49e1-a220-8b7cc0eba72c tempest-ServersAdmin275Test-2011844955 tempest-ServersAdmin275Test-2011844955-project-member] Lock "95525483-b7db-427e-87b5-3f946972a250" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.563s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  797.906278] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8696b9c5-63f6-4b76-92d9-5b4183f07af8 tempest-DeleteServersAdminTestJSON-690863121 tempest-DeleteServersAdminTestJSON-690863121-project-member] Lock "788343e6-5c24-4e9b-9c74-e14f3b179cdb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.055s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  797.956397] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Releasing lock "refresh_cache-f0e88cef-300d-42a4-9cb6-843dc85da6a3" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  797.956866] env[65478]: DEBUG nova.compute.manager [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Instance network_info: |[{"id": "fb55a6bb-2879-44ea-b228-fe4609c36e10", "address": "fa:16:3e:20:00:e4", "network": {"id": "a0fc71cb-b2b3-4c49-84f4-a690fb3e140e", "bridge": "br-int", "label": "tempest-ServersTestJSON-389312898-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c85e7e15986e4e379de765011083021f", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "dacd109c-2442-41b8-b612-7ed3efbdaa94", "external-id": "nsx-vlan-transportzone-940", "segmentation_id": 940, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapfb55a6bb-28", "ovs_interfaceid": "fb55a6bb-2879-44ea-b228-fe4609c36e10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  797.957527] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:20:00:e4', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': 'dacd109c-2442-41b8-b612-7ed3efbdaa94', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': 'fb55a6bb-2879-44ea-b228-fe4609c36e10', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  797.967029] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Creating folder: Project (c85e7e15986e4e379de765011083021f). Parent ref: group-v1161186. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  797.967505] env[65478]: DEBUG oslo_vmware.service [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-4158bda7-6e3a-4632-b349-687f0920e5d8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  797.980939] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Created folder: Project (c85e7e15986e4e379de765011083021f) in parent group-v1161186.
[  797.981401] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Creating folder: Instances. Parent ref: group-v1161263. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  797.982432] env[65478]: DEBUG oslo_vmware.service [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-f5c612e9-b09f-43c8-8f32-fd8aafcf0679 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  797.986428] env[65478]: DEBUG oslo_concurrency.lockutils [req-621ad045-dd22-480c-8e12-28fba7c3aa48 req-35a13334-baab-443e-a498-6c129f6b883f service nova] Releasing lock "refresh_cache-d978e71d-2c30-4a76-b000-6ddf3203ab10" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  797.986612] env[65478]: DEBUG nova.compute.manager [req-621ad045-dd22-480c-8e12-28fba7c3aa48 req-35a13334-baab-443e-a498-6c129f6b883f service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Received event network-changed-457c1734-c99a-4d71-a200-0341a9e3bdd8 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  797.986734] env[65478]: DEBUG nova.compute.manager [req-621ad045-dd22-480c-8e12-28fba7c3aa48 req-35a13334-baab-443e-a498-6c129f6b883f service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Refreshing instance network info cache due to event network-changed-457c1734-c99a-4d71-a200-0341a9e3bdd8. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  797.986893] env[65478]: DEBUG oslo_concurrency.lockutils [req-621ad045-dd22-480c-8e12-28fba7c3aa48 req-35a13334-baab-443e-a498-6c129f6b883f service nova] Acquiring lock "refresh_cache-caf7856c-4e51-4e6c-ad32-2088e15d5d8f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  797.986987] env[65478]: DEBUG oslo_concurrency.lockutils [req-621ad045-dd22-480c-8e12-28fba7c3aa48 req-35a13334-baab-443e-a498-6c129f6b883f service nova] Acquired lock "refresh_cache-caf7856c-4e51-4e6c-ad32-2088e15d5d8f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  797.987119] env[65478]: DEBUG nova.network.neutron [req-621ad045-dd22-480c-8e12-28fba7c3aa48 req-35a13334-baab-443e-a498-6c129f6b883f service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Refreshing network info cache for port 457c1734-c99a-4d71-a200-0341a9e3bdd8 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  797.992205] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Created folder: Instances in parent group-v1161263.
[  797.992593] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  797.992961] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  797.993075] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-e7ddcbb1-7daf-45fc-bf71-a540cfc4b101 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  798.013055] env[65478]: DEBUG oslo_concurrency.lockutils [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Acquiring lock "6ef7bbde-0ba8-44a9-8643-e674a14f3cbc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  798.013562] env[65478]: DEBUG oslo_concurrency.lockutils [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Lock "6ef7bbde-0ba8-44a9-8643-e674a14f3cbc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  798.014251] env[65478]: DEBUG oslo_concurrency.lockutils [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Acquiring lock "6ef7bbde-0ba8-44a9-8643-e674a14f3cbc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  798.014662] env[65478]: DEBUG oslo_concurrency.lockutils [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Lock "6ef7bbde-0ba8-44a9-8643-e674a14f3cbc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  798.014802] env[65478]: DEBUG oslo_concurrency.lockutils [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Lock "6ef7bbde-0ba8-44a9-8643-e674a14f3cbc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  798.017455] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  798.017455] env[65478]:    value = "task-6011688"
[  798.017455] env[65478]:    _type = "Task"
[  798.017455] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  798.022163] env[65478]: INFO nova.compute.manager [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Terminating instance
[  798.028175] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011688, 'name': CreateVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  798.078704] env[65478]: DEBUG oslo_concurrency.lockutils [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Acquiring lock "b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  798.079163] env[65478]: DEBUG oslo_concurrency.lockutils [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Lock "b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  798.079518] env[65478]: DEBUG oslo_concurrency.lockutils [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Acquiring lock "b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  798.079863] env[65478]: DEBUG oslo_concurrency.lockutils [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Lock "b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  798.080177] env[65478]: DEBUG oslo_concurrency.lockutils [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Lock "b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  798.083377] env[65478]: INFO nova.compute.manager [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Terminating instance
[  798.235455] env[65478]: DEBUG oslo_vmware.api [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011685, 'name': CopyVirtualDisk_Task, 'duration_secs': 1.806204} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  798.235455] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Copied Virtual Disk [datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore2] 9b286a00-af27-4012-a596-45bbe98da254/9b286a00-af27-4012-a596-45bbe98da254.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  798.235455] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  798.235780] env[65478]: DEBUG oslo_vmware.service [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-550a5ba9-7d1f-4e8f-81f4-9d583ec8ddf5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  798.244752] env[65478]: DEBUG oslo_vmware.api [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  798.244752] env[65478]:    value = "task-6011689"
[  798.244752] env[65478]:    _type = "Task"
[  798.244752] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  798.254158] env[65478]: DEBUG oslo_vmware.api [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011689, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  798.376154] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Acquiring lock "230cc05f-433e-4510-947f-35466335662d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  798.376154] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Lock "230cc05f-433e-4510-947f-35466335662d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  798.376154] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Acquiring lock "230cc05f-433e-4510-947f-35466335662d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  798.376154] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Lock "230cc05f-433e-4510-947f-35466335662d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  798.376516] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Lock "230cc05f-433e-4510-947f-35466335662d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  798.377439] env[65478]: INFO nova.compute.manager [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Terminating instance
[  798.489038] env[65478]: DEBUG oslo_concurrency.lockutils [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Acquiring lock "4821048b-4b5a-40b5-8888-f00dd28425d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  798.489038] env[65478]: DEBUG oslo_concurrency.lockutils [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Lock "4821048b-4b5a-40b5-8888-f00dd28425d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  798.489038] env[65478]: DEBUG oslo_concurrency.lockutils [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Acquiring lock "4821048b-4b5a-40b5-8888-f00dd28425d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  798.489038] env[65478]: DEBUG oslo_concurrency.lockutils [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Lock "4821048b-4b5a-40b5-8888-f00dd28425d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  798.489197] env[65478]: DEBUG oslo_concurrency.lockutils [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Lock "4821048b-4b5a-40b5-8888-f00dd28425d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  798.490948] env[65478]: WARNING neutronclient.v2_0.client [req-621ad045-dd22-480c-8e12-28fba7c3aa48 req-35a13334-baab-443e-a498-6c129f6b883f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  798.494045] env[65478]: INFO nova.compute.manager [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Terminating instance
[  798.532351] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011688, 'name': CreateVM_Task} progress is 99%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  798.533738] env[65478]: DEBUG nova.compute.manager [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[  798.533929] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  798.535360] env[65478]: DEBUG oslo_vmware.service [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-73a73f43-008b-4740-80d2-2f3f59a96e69 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  798.547165] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  798.547574] env[65478]: DEBUG oslo_vmware.service [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-75d06280-e742-450f-8575-ab59d788aec5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  798.553753] env[65478]: DEBUG oslo_vmware.api [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for the task: (returnval){
[  798.553753] env[65478]:    value = "task-6011690"
[  798.553753] env[65478]:    _type = "Task"
[  798.553753] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  798.563758] env[65478]: DEBUG oslo_vmware.api [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011690, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  798.587741] env[65478]: DEBUG nova.compute.manager [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[  798.587915] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  798.589087] env[65478]: DEBUG oslo_vmware.service [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c00f621f-4c62-4b9a-af09-5a4e3f586eb3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  798.597250] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  798.597851] env[65478]: DEBUG oslo_vmware.service [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-da7bfded-1df5-4154-bb30-8041dacd54ae {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  798.604987] env[65478]: DEBUG oslo_vmware.api [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Waiting for the task: (returnval){
[  798.604987] env[65478]:    value = "task-6011691"
[  798.604987] env[65478]:    _type = "Task"
[  798.604987] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  798.615751] env[65478]: DEBUG oslo_vmware.api [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Task: {'id': task-6011691, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  798.755316] env[65478]: DEBUG oslo_vmware.api [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011689, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.131493} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  798.756068] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  798.756523] env[65478]: DEBUG oslo_vmware.service [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1d1dee32-3bfe-41f6-8292-842c9a4d7be9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  798.784871] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Reconfiguring VM instance instance-0000001a to attach disk [datastore2] 9b286a00-af27-4012-a596-45bbe98da254/9b286a00-af27-4012-a596-45bbe98da254.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  798.785623] env[65478]: DEBUG oslo_vmware.service [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-e666cfae-78bc-42d6-aa0f-08b34c7dac5d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  798.811744] env[65478]: DEBUG oslo_vmware.api [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  798.811744] env[65478]:    value = "task-6011692"
[  798.811744] env[65478]:    _type = "Task"
[  798.811744] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  798.822810] env[65478]: DEBUG oslo_vmware.api [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011692, 'name': ReconfigVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  798.882898] env[65478]: DEBUG nova.compute.manager [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[  798.883341] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  798.884323] env[65478]: DEBUG oslo_vmware.service [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e2bb3cd3-faca-4c7f-908e-e48c98080d6a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  798.891854] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  798.892160] env[65478]: DEBUG oslo_vmware.service [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-d6a3d003-5180-49a0-abd0-5a7fbec4b50e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  798.897526] env[65478]: DEBUG oslo_vmware.api [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Waiting for the task: (returnval){
[  798.897526] env[65478]:    value = "task-6011693"
[  798.897526] env[65478]:    _type = "Task"
[  798.897526] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  798.909656] env[65478]: DEBUG oslo_vmware.api [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011693, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  799.000441] env[65478]: DEBUG nova.compute.manager [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[  799.000649] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  799.001777] env[65478]: DEBUG oslo_vmware.service [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-71b3ba84-5ce9-473d-95ef-f68564c9b52e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  799.008926] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  799.009295] env[65478]: DEBUG oslo_vmware.service [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-bab8ea03-0c0c-4722-affe-3ac91c025434 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  799.014766] env[65478]: DEBUG oslo_vmware.api [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Waiting for the task: (returnval){
[  799.014766] env[65478]:    value = "task-6011694"
[  799.014766] env[65478]:    _type = "Task"
[  799.014766] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  799.027462] env[65478]: DEBUG oslo_vmware.api [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Task: {'id': task-6011694, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  799.032115] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011688, 'name': CreateVM_Task, 'duration_secs': 0.537815} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  799.032280] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  799.036027] env[65478]: WARNING neutronclient.v2_0.client [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  799.036315] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  799.036447] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  799.036766] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Acquired external semaphore "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  799.037131] env[65478]: DEBUG oslo_vmware.service [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-b7e4ff61-6a65-44e4-ba44-d6aa94ba6763 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  799.051591] env[65478]: DEBUG oslo_vmware.api [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Waiting for the task: (returnval){
[  799.051591] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52bd3012-cb6b-2a94-991f-ca88cee7eb65"
[  799.051591] env[65478]:    _type = "Task"
[  799.051591] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  799.068094] env[65478]: DEBUG oslo_vmware.api [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011690, 'name': PowerOffVM_Task, 'duration_secs': 0.257596} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  799.072858] env[65478]: DEBUG oslo_vmware.api [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52bd3012-cb6b-2a94-991f-ca88cee7eb65, 'name': SearchDatastore_Task, 'duration_secs': 0.010793} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  799.073336] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  799.073532] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  799.073882] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  799.074254] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  799.074556] env[65478]: DEBUG oslo_vmware.service [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-ff5889bf-992b-486f-83e1-59aad61f9551 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  799.075777] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  799.075982] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  799.076144] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Creating directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  799.076418] env[65478]: DEBUG oslo_vmware.service [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-9c52217e-1a6e-49eb-8906-25fea4537c05 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  799.088061] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Created directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  799.088061] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Folder [datastore1] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  799.088745] env[65478]: DEBUG oslo_vmware.service [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-525b57b7-9244-44a3-a612-8285ae8e73d5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  799.096265] env[65478]: DEBUG oslo_vmware.api [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Waiting for the task: (returnval){
[  799.096265] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52be4c3a-6628-167e-867e-13a7a67c29d1"
[  799.096265] env[65478]:    _type = "Task"
[  799.096265] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  799.108716] env[65478]: DEBUG oslo_vmware.api [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52be4c3a-6628-167e-867e-13a7a67c29d1, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  799.122358] env[65478]: DEBUG oslo_vmware.api [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Task: {'id': task-6011691, 'name': PowerOffVM_Task, 'duration_secs': 0.262841} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  799.122701] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  799.123028] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  799.123129] env[65478]: DEBUG oslo_vmware.service [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-9ad5dcce-fdb2-4564-aa1a-62800cdaea03 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  799.184905] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  799.185356] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Deleting contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  799.185356] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Deleting the datastore file [datastore1] 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  799.185655] env[65478]: DEBUG oslo_vmware.service [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-5880536e-9f4e-4dda-a1ac-2753c2ae39da {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  799.191160] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  799.191564] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Deleting contents of the VM from datastore datastore2 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  799.191564] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Deleting the datastore file [datastore2] b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  799.191805] env[65478]: DEBUG oslo_vmware.service [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-3b4a0454-08fe-4f00-849d-122a2d12b0b9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  799.196565] env[65478]: DEBUG oslo_vmware.api [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for the task: (returnval){
[  799.196565] env[65478]:    value = "task-6011697"
[  799.196565] env[65478]:    _type = "Task"
[  799.196565] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  799.206938] env[65478]: DEBUG oslo_vmware.api [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Waiting for the task: (returnval){
[  799.206938] env[65478]:    value = "task-6011698"
[  799.206938] env[65478]:    _type = "Task"
[  799.206938] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  799.216817] env[65478]: DEBUG oslo_vmware.api [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011697, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  799.221994] env[65478]: DEBUG oslo_vmware.api [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Task: {'id': task-6011698, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  799.321641] env[65478]: DEBUG oslo_vmware.api [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011692, 'name': ReconfigVM_Task, 'duration_secs': 0.378757} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  799.321641] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Reconfigured VM instance instance-0000001a to attach disk [datastore2] 9b286a00-af27-4012-a596-45bbe98da254/9b286a00-af27-4012-a596-45bbe98da254.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  799.322364] env[65478]: DEBUG oslo_vmware.service [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-2104b5d8-5f53-4dd8-af63-30e017649d7b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  799.328476] env[65478]: DEBUG oslo_vmware.api [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  799.328476] env[65478]:    value = "task-6011699"
[  799.328476] env[65478]:    _type = "Task"
[  799.328476] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  799.340300] env[65478]: DEBUG oslo_vmware.api [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011699, 'name': Rename_Task} progress is 5%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  799.408838] env[65478]: DEBUG oslo_vmware.api [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011693, 'name': PowerOffVM_Task, 'duration_secs': 0.206322} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  799.409088] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  799.409630] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  799.410068] env[65478]: DEBUG oslo_vmware.service [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-60cc1265-ae03-4229-99de-57846e72bdaf {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  799.482873] env[65478]: WARNING neutronclient.v2_0.client [req-621ad045-dd22-480c-8e12-28fba7c3aa48 req-35a13334-baab-443e-a498-6c129f6b883f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  799.529505] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  799.529505] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Deleting contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  799.529741] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Deleting the datastore file [datastore1] 230cc05f-433e-4510-947f-35466335662d {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  799.531076] env[65478]: DEBUG oslo_vmware.service [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-acf19d67-d58a-421d-9457-68861ab32ef7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  799.537754] env[65478]: DEBUG oslo_vmware.api [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Task: {'id': task-6011694, 'name': PowerOffVM_Task, 'duration_secs': 0.201905} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  799.538777] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  799.538897] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  799.539322] env[65478]: DEBUG oslo_vmware.service [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-634225f9-cbc1-4c61-8ca4-cf62943e82de {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  799.546347] env[65478]: DEBUG oslo_vmware.api [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Waiting for the task: (returnval){
[  799.546347] env[65478]:    value = "task-6011701"
[  799.546347] env[65478]:    _type = "Task"
[  799.546347] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  799.562127] env[65478]: DEBUG oslo_vmware.api [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011701, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  799.611475] env[65478]: DEBUG oslo_vmware.api [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52be4c3a-6628-167e-867e-13a7a67c29d1, 'name': SearchDatastore_Task, 'duration_secs': 0.011342} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  799.612885] env[65478]: DEBUG nova.network.neutron [req-621ad045-dd22-480c-8e12-28fba7c3aa48 req-35a13334-baab-443e-a498-6c129f6b883f service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Updated VIF entry in instance network info cache for port 457c1734-c99a-4d71-a200-0341a9e3bdd8. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  799.613802] env[65478]: DEBUG nova.network.neutron [req-621ad045-dd22-480c-8e12-28fba7c3aa48 req-35a13334-baab-443e-a498-6c129f6b883f service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Updating instance_info_cache with network_info: [{"id": "457c1734-c99a-4d71-a200-0341a9e3bdd8", "address": "fa:16:3e:90:77:31", "network": {"id": "eab0e877-79ef-45b8-a26f-7dd517a13b53", "bridge": "br-int", "label": "tempest-FloatingIPsAssociationTestJSON-364284774-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "7dd8c4cd35c44466b1991950f28d886b", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "054fcd1e-638e-425a-a1de-78cb188ae026", "external-id": "nsx-vlan-transportzone-658", "segmentation_id": 658, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap457c1734-c9", "ovs_interfaceid": "457c1734-c99a-4d71-a200-0341a9e3bdd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  799.614709] env[65478]: DEBUG oslo_vmware.service [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-5fdbc89e-1d6d-4446-a5ab-f3f120c13e4b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  799.621480] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  799.621480] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Deleting contents of the VM from datastore datastore2 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  799.621480] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Deleting the datastore file [datastore2] 4821048b-4b5a-40b5-8888-f00dd28425d1 {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  799.621480] env[65478]: DEBUG oslo_vmware.service [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-d6a79f7d-0455-4da2-80ea-e5f928805a77 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  799.629638] env[65478]: DEBUG oslo_vmware.api [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Waiting for the task: (returnval){
[  799.629638] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]5290a48c-6502-297e-3731-c623ae4e7f40"
[  799.629638] env[65478]:    _type = "Task"
[  799.629638] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  799.637502] env[65478]: DEBUG oslo_vmware.api [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Waiting for the task: (returnval){
[  799.637502] env[65478]:    value = "task-6011703"
[  799.637502] env[65478]:    _type = "Task"
[  799.637502] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  799.655194] env[65478]: DEBUG oslo_vmware.api [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Task: {'id': task-6011703, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  799.667244] env[65478]: DEBUG oslo_vmware.api [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5290a48c-6502-297e-3731-c623ae4e7f40, 'name': SearchDatastore_Task, 'duration_secs': 0.011598} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  799.667808] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  799.668159] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Copying Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] f0e88cef-300d-42a4-9cb6-843dc85da6a3/f0e88cef-300d-42a4-9cb6-843dc85da6a3.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  799.668761] env[65478]: DEBUG oslo_vmware.service [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-17b10a25-c1e2-4e6b-a125-ad892dd098f7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  799.677117] env[65478]: DEBUG oslo_vmware.api [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Waiting for the task: (returnval){
[  799.677117] env[65478]:    value = "task-6011704"
[  799.677117] env[65478]:    _type = "Task"
[  799.677117] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  799.690531] env[65478]: DEBUG oslo_vmware.api [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Task: {'id': task-6011704, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  799.718750] env[65478]: DEBUG oslo_vmware.api [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011697, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.265166} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  799.719062] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  799.721224] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Deleted contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  799.721466] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  799.725048] env[65478]: INFO nova.compute.manager [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Took 1.19 seconds to destroy the instance on the hypervisor.
[  799.726872] env[65478]: DEBUG oslo_vmware.api [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Task: {'id': task-6011698, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.260575} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  799.726872] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  799.727134] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Deleted contents of the VM from datastore datastore2 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  799.727193] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  799.729353] env[65478]: INFO nova.compute.manager [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Took 1.14 seconds to destroy the instance on the hypervisor.
[  799.729353] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  799.731650] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  799.731650] env[65478]: DEBUG nova.compute.manager [-] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[  799.731760] env[65478]: DEBUG nova.compute.manager [-] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[  799.731917] env[65478]: DEBUG nova.network.neutron [-] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[  799.732534] env[65478]: DEBUG nova.network.neutron [-] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[  799.733172] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  799.736259] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  799.838967] env[65478]: DEBUG oslo_vmware.api [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011699, 'name': Rename_Task, 'duration_secs': 0.170268} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  799.838967] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  799.838967] env[65478]: DEBUG oslo_vmware.service [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-a68b55a8-0726-4777-be20-faa14ffd873d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  799.844752] env[65478]: DEBUG oslo_vmware.api [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  799.844752] env[65478]:    value = "task-6011705"
[  799.844752] env[65478]:    _type = "Task"
[  799.844752] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  799.852640] env[65478]: DEBUG oslo_vmware.api [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011705, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  799.883197] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  799.904657] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  800.064646] env[65478]: DEBUG oslo_vmware.api [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Task: {'id': task-6011701, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.162957} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  800.066741] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  800.066869] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Deleted contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  800.067048] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  800.067506] env[65478]: INFO nova.compute.manager [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 230cc05f-433e-4510-947f-35466335662d] Took 1.18 seconds to destroy the instance on the hypervisor.
[  800.070559] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  800.071107] env[65478]: DEBUG nova.compute.manager [-] [instance: 230cc05f-433e-4510-947f-35466335662d] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[  800.071107] env[65478]: DEBUG nova.network.neutron [-] [instance: 230cc05f-433e-4510-947f-35466335662d] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[  800.071181] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  800.130898] env[65478]: DEBUG oslo_concurrency.lockutils [req-621ad045-dd22-480c-8e12-28fba7c3aa48 req-35a13334-baab-443e-a498-6c129f6b883f service nova] Releasing lock "refresh_cache-caf7856c-4e51-4e6c-ad32-2088e15d5d8f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  800.142108] env[65478]: DEBUG nova.compute.manager [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Received event network-vif-deleted-958d3060-f044-4655-8c5e-bd81773ad096 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  800.148268] env[65478]: DEBUG nova.compute.manager [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Received event network-vif-deleted-c753d998-c733-4ef7-b4fc-008c7024f5ef {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  800.148519] env[65478]: DEBUG nova.compute.manager [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Received event network-vif-plugged-fc5c04e7-8dac-4f1f-a5e4-9f9d31498143 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  800.149032] env[65478]: DEBUG oslo_concurrency.lockutils [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] Acquiring lock "9b286a00-af27-4012-a596-45bbe98da254-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  800.149509] env[65478]: DEBUG oslo_concurrency.lockutils [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] Lock "9b286a00-af27-4012-a596-45bbe98da254-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  800.149726] env[65478]: DEBUG oslo_concurrency.lockutils [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] Lock "9b286a00-af27-4012-a596-45bbe98da254-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  800.149927] env[65478]: DEBUG nova.compute.manager [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] [instance: 9b286a00-af27-4012-a596-45bbe98da254] No waiting events found dispatching network-vif-plugged-fc5c04e7-8dac-4f1f-a5e4-9f9d31498143 {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  800.151977] env[65478]: WARNING nova.compute.manager [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Received unexpected event network-vif-plugged-fc5c04e7-8dac-4f1f-a5e4-9f9d31498143 for instance with vm_state building and task_state spawning.
[  800.151977] env[65478]: DEBUG nova.compute.manager [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Received event network-changed-fc5c04e7-8dac-4f1f-a5e4-9f9d31498143 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  800.151977] env[65478]: DEBUG nova.compute.manager [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Refreshing instance network info cache due to event network-changed-fc5c04e7-8dac-4f1f-a5e4-9f9d31498143. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  800.151977] env[65478]: DEBUG oslo_concurrency.lockutils [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] Acquiring lock "refresh_cache-9b286a00-af27-4012-a596-45bbe98da254" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  800.157439] env[65478]: DEBUG oslo_concurrency.lockutils [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] Acquired lock "refresh_cache-9b286a00-af27-4012-a596-45bbe98da254" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  800.158559] env[65478]: DEBUG nova.network.neutron [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Refreshing network info cache for port fc5c04e7-8dac-4f1f-a5e4-9f9d31498143 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  800.162340] env[65478]: DEBUG oslo_vmware.api [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Task: {'id': task-6011703, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.176023} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  800.162808] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  800.163510] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Deleted contents of the VM from datastore datastore2 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  800.163510] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  800.163510] env[65478]: INFO nova.compute.manager [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Took 1.16 seconds to destroy the instance on the hypervisor.
[  800.164326] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  800.165261] env[65478]: DEBUG nova.compute.manager [-] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[  800.165261] env[65478]: DEBUG nova.network.neutron [-] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[  800.165261] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  800.196871] env[65478]: DEBUG oslo_vmware.api [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Task: {'id': task-6011704, 'name': CopyVirtualDisk_Task} progress is 77%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  800.278244] env[65478]: DEBUG oslo_concurrency.lockutils [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Acquiring lock "6f6c4cda-9439-47dd-810c-25b0516585e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  800.279251] env[65478]: DEBUG oslo_concurrency.lockutils [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Lock "6f6c4cda-9439-47dd-810c-25b0516585e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  800.354262] env[65478]: DEBUG oslo_vmware.api [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011705, 'name': PowerOnVM_Task} progress is 89%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  800.457147] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  800.516177] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  800.664036] env[65478]: WARNING neutronclient.v2_0.client [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  800.689899] env[65478]: DEBUG oslo_vmware.api [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Task: {'id': task-6011704, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.52726} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  800.690188] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Copied Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] f0e88cef-300d-42a4-9cb6-843dc85da6a3/f0e88cef-300d-42a4-9cb6-843dc85da6a3.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  800.690406] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  800.694020] env[65478]: DEBUG oslo_vmware.service [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-88f87d5e-5e69-409b-a5ee-fe3021ae6db5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  800.697949] env[65478]: DEBUG oslo_vmware.api [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Waiting for the task: (returnval){
[  800.697949] env[65478]:    value = "task-6011706"
[  800.697949] env[65478]:    _type = "Task"
[  800.697949] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  800.708933] env[65478]: DEBUG oslo_vmware.api [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Task: {'id': task-6011706, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  800.782009] env[65478]: DEBUG nova.compute.manager [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  800.857521] env[65478]: DEBUG oslo_vmware.api [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011705, 'name': PowerOnVM_Task, 'duration_secs': 0.727162} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  800.858604] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  800.858794] env[65478]: INFO nova.compute.manager [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Took 9.69 seconds to spawn the instance on the hypervisor.
[  800.858942] env[65478]: DEBUG nova.compute.manager [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  800.859838] env[65478]: DEBUG oslo_vmware.service [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-97663296-737a-4499-b0bd-850ddf281970 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  800.873366] env[65478]: DEBUG nova.network.neutron [-] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  800.879793] env[65478]: DEBUG nova.network.neutron [-] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  801.207039] env[65478]: DEBUG oslo_vmware.api [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Task: {'id': task-6011706, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.094242} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  801.207529] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  801.208257] env[65478]: DEBUG oslo_vmware.service [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ba5d4fc6-af0a-4914-9869-927fd22f3026 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  801.238490] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Reconfiguring VM instance instance-0000001b to attach disk [datastore1] f0e88cef-300d-42a4-9cb6-843dc85da6a3/f0e88cef-300d-42a4-9cb6-843dc85da6a3.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  801.238932] env[65478]: DEBUG oslo_vmware.service [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-b73729aa-56af-499b-a959-d67258f5ff7b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  801.259523] env[65478]: DEBUG oslo_vmware.api [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Waiting for the task: (returnval){
[  801.259523] env[65478]:    value = "task-6011708"
[  801.259523] env[65478]:    _type = "Task"
[  801.259523] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  801.269242] env[65478]: DEBUG oslo_vmware.api [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Task: {'id': task-6011708, 'name': ReconfigVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  801.311977] env[65478]: DEBUG oslo_concurrency.lockutils [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  801.311977] env[65478]: DEBUG oslo_concurrency.lockutils [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  801.311977] env[65478]: INFO nova.compute.claims [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  801.314955] env[65478]: DEBUG nova.network.neutron [-] [instance: 230cc05f-433e-4510-947f-35466335662d] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  801.379512] env[65478]: INFO nova.compute.manager [-] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Took 1.65 seconds to deallocate network for instance.
[  801.394210] env[65478]: INFO nova.compute.manager [-] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Took 1.66 seconds to deallocate network for instance.
[  801.394937] env[65478]: INFO nova.compute.manager [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Took 21.45 seconds to build instance.
[  801.513373] env[65478]: WARNING neutronclient.v2_0.client [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  801.571742] env[65478]: DEBUG nova.compute.manager [req-abcdbfca-c7cf-495f-baf4-9adfdce450a1 req-86e746ca-f337-46d0-80de-4cf4850b7451 service nova] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Received event network-changed-5c9a8578-bb94-4d72-acef-25b60278df21 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  801.572132] env[65478]: DEBUG nova.compute.manager [req-abcdbfca-c7cf-495f-baf4-9adfdce450a1 req-86e746ca-f337-46d0-80de-4cf4850b7451 service nova] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Refreshing instance network info cache due to event network-changed-5c9a8578-bb94-4d72-acef-25b60278df21. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  801.574368] env[65478]: DEBUG oslo_concurrency.lockutils [req-abcdbfca-c7cf-495f-baf4-9adfdce450a1 req-86e746ca-f337-46d0-80de-4cf4850b7451 service nova] Acquiring lock "refresh_cache-eb076624-c76c-47da-9320-5fc13a51b365" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  801.579266] env[65478]: DEBUG oslo_concurrency.lockutils [req-abcdbfca-c7cf-495f-baf4-9adfdce450a1 req-86e746ca-f337-46d0-80de-4cf4850b7451 service nova] Acquired lock "refresh_cache-eb076624-c76c-47da-9320-5fc13a51b365" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  801.579266] env[65478]: DEBUG nova.network.neutron [req-abcdbfca-c7cf-495f-baf4-9adfdce450a1 req-86e746ca-f337-46d0-80de-4cf4850b7451 service nova] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Refreshing network info cache for port 5c9a8578-bb94-4d72-acef-25b60278df21 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  801.612512] env[65478]: DEBUG nova.network.neutron [-] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  801.628319] env[65478]: DEBUG nova.network.neutron [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Updated VIF entry in instance network info cache for port fc5c04e7-8dac-4f1f-a5e4-9f9d31498143. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  801.629843] env[65478]: DEBUG nova.network.neutron [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Updating instance_info_cache with network_info: [{"id": "fc5c04e7-8dac-4f1f-a5e4-9f9d31498143", "address": "fa:16:3e:17:84:6e", "network": {"id": "7cd93ed0-202b-4b24-a579-dd5eacc8ea60", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140861423-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "3c6c9b0fcb1f453a8108522a8924bda3", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "d4345ef6-a7c8-4c1c-badf-a0d4f578b61c", "external-id": "nsx-vlan-transportzone-677", "segmentation_id": 677, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapfc5c04e7-8d", "ovs_interfaceid": "fc5c04e7-8dac-4f1f-a5e4-9f9d31498143", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  801.772272] env[65478]: DEBUG oslo_vmware.api [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Task: {'id': task-6011708, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  801.823148] env[65478]: INFO nova.compute.manager [-] [instance: 230cc05f-433e-4510-947f-35466335662d] Took 1.75 seconds to deallocate network for instance.
[  801.905672] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dde5fd7a-1304-47c8-a187-ad9bf03e5361 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lock "9b286a00-af27-4012-a596-45bbe98da254" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.026s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  801.907499] env[65478]: DEBUG oslo_concurrency.lockutils [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  801.913962] env[65478]: DEBUG oslo_concurrency.lockutils [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  802.084956] env[65478]: WARNING neutronclient.v2_0.client [req-abcdbfca-c7cf-495f-baf4-9adfdce450a1 req-86e746ca-f337-46d0-80de-4cf4850b7451 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  802.117078] env[65478]: INFO nova.compute.manager [-] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Took 1.95 seconds to deallocate network for instance.
[  802.131798] env[65478]: DEBUG oslo_concurrency.lockutils [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] Releasing lock "refresh_cache-9b286a00-af27-4012-a596-45bbe98da254" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  802.131993] env[65478]: DEBUG nova.compute.manager [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Received event network-vif-plugged-fb55a6bb-2879-44ea-b228-fe4609c36e10 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  802.132231] env[65478]: DEBUG oslo_concurrency.lockutils [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] Acquiring lock "f0e88cef-300d-42a4-9cb6-843dc85da6a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  802.132400] env[65478]: DEBUG oslo_concurrency.lockutils [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] Lock "f0e88cef-300d-42a4-9cb6-843dc85da6a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  802.132537] env[65478]: DEBUG oslo_concurrency.lockutils [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] Lock "f0e88cef-300d-42a4-9cb6-843dc85da6a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  802.132987] env[65478]: DEBUG nova.compute.manager [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] No waiting events found dispatching network-vif-plugged-fb55a6bb-2879-44ea-b228-fe4609c36e10 {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  802.132987] env[65478]: WARNING nova.compute.manager [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Received unexpected event network-vif-plugged-fb55a6bb-2879-44ea-b228-fe4609c36e10 for instance with vm_state building and task_state spawning.
[  802.132987] env[65478]: DEBUG nova.compute.manager [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Received event network-changed-fb55a6bb-2879-44ea-b228-fe4609c36e10 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  802.133237] env[65478]: DEBUG nova.compute.manager [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Refreshing instance network info cache due to event network-changed-fb55a6bb-2879-44ea-b228-fe4609c36e10. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  802.133569] env[65478]: DEBUG oslo_concurrency.lockutils [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] Acquiring lock "refresh_cache-f0e88cef-300d-42a4-9cb6-843dc85da6a3" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  802.133730] env[65478]: DEBUG oslo_concurrency.lockutils [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] Acquired lock "refresh_cache-f0e88cef-300d-42a4-9cb6-843dc85da6a3" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  802.133900] env[65478]: DEBUG nova.network.neutron [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Refreshing network info cache for port fb55a6bb-2879-44ea-b228-fe4609c36e10 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  802.272685] env[65478]: DEBUG oslo_vmware.api [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Task: {'id': task-6011708, 'name': ReconfigVM_Task, 'duration_secs': 0.995382} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  802.273060] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Reconfigured VM instance instance-0000001b to attach disk [datastore1] f0e88cef-300d-42a4-9cb6-843dc85da6a3/f0e88cef-300d-42a4-9cb6-843dc85da6a3.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  802.274205] env[65478]: DEBUG oslo_vmware.service [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-91cc772d-0277-407c-8e9d-96514e7f187d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  802.283745] env[65478]: DEBUG oslo_vmware.api [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Waiting for the task: (returnval){
[  802.283745] env[65478]:    value = "task-6011709"
[  802.283745] env[65478]:    _type = "Task"
[  802.283745] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  802.288509] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Acquiring lock "fbf21f21-d370-4a6a-ae24-0e6840464e24" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  802.289125] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Lock "fbf21f21-d370-4a6a-ae24-0e6840464e24" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  802.297367] env[65478]: DEBUG oslo_vmware.api [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Task: {'id': task-6011709, 'name': Rename_Task} progress is 10%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  802.325386] env[65478]: INFO nova.compute.manager [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Rebuilding instance
[  802.334416] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  802.404217] env[65478]: DEBUG nova.compute.manager [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  802.405289] env[65478]: DEBUG oslo_vmware.service [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3617b132-8a1a-430c-83c3-831344dd69a3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  802.626722] env[65478]: DEBUG oslo_concurrency.lockutils [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  802.636804] env[65478]: WARNING neutronclient.v2_0.client [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  802.676249] env[65478]: DEBUG oslo_vmware.service [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-cc7f7021-2eb1-4e76-86ba-30ab48e623af {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  802.684408] env[65478]: DEBUG oslo_vmware.service [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-87f043c1-2322-428f-b3d5-85d9d9b0a1be {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  802.716783] env[65478]: DEBUG oslo_vmware.service [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ffedf0ac-1fb5-4103-a318-412a693c60b0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  802.724547] env[65478]: DEBUG oslo_vmware.service [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1a2bbd21-1ebf-4d4c-bdc8-3e9cb8b8c13c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  802.741998] env[65478]: DEBUG nova.compute.provider_tree [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  802.792026] env[65478]: DEBUG nova.compute.manager [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  802.800409] env[65478]: DEBUG oslo_vmware.api [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Task: {'id': task-6011709, 'name': Rename_Task, 'duration_secs': 0.242981} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  802.800591] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  802.802063] env[65478]: DEBUG oslo_vmware.service [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-b567c025-9170-4632-a0b8-bd96eaae0a71 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  802.810633] env[65478]: DEBUG oslo_vmware.api [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Waiting for the task: (returnval){
[  802.810633] env[65478]:    value = "task-6011710"
[  802.810633] env[65478]:    _type = "Task"
[  802.810633] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  802.818134] env[65478]: DEBUG oslo_vmware.api [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Task: {'id': task-6011710, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  803.274401] env[65478]: ERROR nova.scheduler.client.report [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [req-2af1b760-0019-441a-9c9f-d6a1d65c5bef] Failed to update inventory to [{'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}}] for resource provider with UUID e3a5020e-0218-494b-ae38-8b55aa77f6f5.  Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n resource provider generation conflict  ", "code": "placement.concurrent_update", "request_id": "req-2af1b760-0019-441a-9c9f-d6a1d65c5bef"}]}
[  803.301277] env[65478]: DEBUG nova.scheduler.client.report [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Refreshing inventories for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
[  803.325174] env[65478]: DEBUG oslo_vmware.api [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Task: {'id': task-6011710, 'name': PowerOnVM_Task} progress is 66%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  803.326033] env[65478]: DEBUG nova.scheduler.client.report [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Updating ProviderTree inventory for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
[  803.326252] env[65478]: DEBUG nova.compute.provider_tree [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  803.330641] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  803.343762] env[65478]: DEBUG nova.scheduler.client.report [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Refreshing aggregate associations for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5, aggregates: None {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
[  803.373206] env[65478]: DEBUG nova.scheduler.client.report [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Refreshing trait associations for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_VMDK,COMPUTE_IMAGE_TYPE_ISO,HW_ARCH_X86_64,COMPUTE_SAME_HOST_COLD_MIGRATE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
[  803.421056] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  803.421567] env[65478]: DEBUG oslo_vmware.service [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-82355fbc-6003-4d51-b280-af64d954c686 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  803.432707] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Waiting for the task: (returnval){
[  803.432707] env[65478]:    value = "task-6011711"
[  803.432707] env[65478]:    _type = "Task"
[  803.432707] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  803.450740] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011711, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  803.715952] env[65478]: DEBUG oslo_vmware.service [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c06781dc-9a69-456f-8ecb-6450e31c06ab {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  803.724282] env[65478]: DEBUG oslo_vmware.service [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-66dd6e4a-b4d3-4247-ac6e-32e1389ff628 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  803.771420] env[65478]: DEBUG oslo_vmware.service [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-cddaa743-fcea-4459-af69-82254738ad0a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  803.782577] env[65478]: DEBUG oslo_vmware.service [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e3369d2d-a57f-44e4-b0e0-234347752712 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  803.799161] env[65478]: DEBUG nova.compute.provider_tree [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  803.824520] env[65478]: DEBUG oslo_vmware.api [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Task: {'id': task-6011710, 'name': PowerOnVM_Task, 'duration_secs': 0.968585} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  803.824964] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  803.825529] env[65478]: INFO nova.compute.manager [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Took 10.07 seconds to spawn the instance on the hypervisor.
[  803.825529] env[65478]: DEBUG nova.compute.manager [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  803.826608] env[65478]: DEBUG oslo_vmware.service [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-67aaa51a-1f0f-4f03-b15f-ad5db6455e36 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  803.944332] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011711, 'name': PowerOffVM_Task, 'duration_secs': 0.27913} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  803.944332] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  803.945546] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  803.945742] env[65478]: DEBUG oslo_vmware.service [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-7b84e7b9-6b27-44d8-9306-6a465f5d23ac {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  803.954486] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  803.954486] env[65478]: DEBUG oslo_vmware.service [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-6b85e599-e4af-49f2-b6fc-3deddc2aedb2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  803.979679] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  803.979927] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Deleting contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  803.979927] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Deleting the datastore file [datastore1] 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3 {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  803.980161] env[65478]: DEBUG oslo_vmware.service [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-4002713e-efee-4677-a04e-31531e68bb66 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  803.987370] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Waiting for the task: (returnval){
[  803.987370] env[65478]:    value = "task-6011713"
[  803.987370] env[65478]:    _type = "Task"
[  803.987370] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  803.997076] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011713, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  804.152571] env[65478]: WARNING neutronclient.v2_0.client [req-abcdbfca-c7cf-495f-baf4-9adfdce450a1 req-86e746ca-f337-46d0-80de-4cf4850b7451 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  804.352176] env[65478]: WARNING neutronclient.v2_0.client [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  804.362541] env[65478]: INFO nova.compute.manager [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Took 22.65 seconds to build instance.
[  804.381575] env[65478]: DEBUG nova.scheduler.client.report [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Updated inventory for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with generation 37 in Placement from set_inventory_for_provider using data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}}
[  804.381780] env[65478]: DEBUG nova.compute.provider_tree [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Updating resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 generation from 37 to 38 during operation: update_inventory {{(pid=65478) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
[  804.381917] env[65478]: DEBUG nova.compute.provider_tree [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  804.435961] env[65478]: DEBUG nova.network.neutron [req-abcdbfca-c7cf-495f-baf4-9adfdce450a1 req-86e746ca-f337-46d0-80de-4cf4850b7451 service nova] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Updated VIF entry in instance network info cache for port 5c9a8578-bb94-4d72-acef-25b60278df21. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  804.436287] env[65478]: DEBUG nova.network.neutron [req-abcdbfca-c7cf-495f-baf4-9adfdce450a1 req-86e746ca-f337-46d0-80de-4cf4850b7451 service nova] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Updating instance_info_cache with network_info: [{"id": "5c9a8578-bb94-4d72-acef-25b60278df21", "address": "fa:16:3e:ae:3e:c3", "network": {"id": "f4cdd871-29d3-4e5f-9c28-ce69831a9d5b", "bridge": "br-int", "label": "tempest-FloatingIPsAssociationNegativeTestJSON-434449668-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "99bc07d4a2be4da3b5bb4900ea76450b", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "c68b7663-4f0e-47f0-ac7f-40c6d952f7bb", "external-id": "nsx-vlan-transportzone-696", "segmentation_id": 696, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap5c9a8578-bb", "ovs_interfaceid": "5c9a8578-bb94-4d72-acef-25b60278df21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  804.506300] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011713, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.211295} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  804.506300] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  804.506858] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Deleted contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  804.506858] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  804.661727] env[65478]: DEBUG nova.network.neutron [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Updated VIF entry in instance network info cache for port fb55a6bb-2879-44ea-b228-fe4609c36e10. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  804.663033] env[65478]: DEBUG nova.network.neutron [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Updating instance_info_cache with network_info: [{"id": "fb55a6bb-2879-44ea-b228-fe4609c36e10", "address": "fa:16:3e:20:00:e4", "network": {"id": "a0fc71cb-b2b3-4c49-84f4-a690fb3e140e", "bridge": "br-int", "label": "tempest-ServersTestJSON-389312898-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c85e7e15986e4e379de765011083021f", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "dacd109c-2442-41b8-b612-7ed3efbdaa94", "external-id": "nsx-vlan-transportzone-940", "segmentation_id": 940, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapfb55a6bb-28", "ovs_interfaceid": "fb55a6bb-2879-44ea-b228-fe4609c36e10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  804.868940] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8552b672-a0ed-4c24-8d2a-6760714747af tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Lock "f0e88cef-300d-42a4-9cb6-843dc85da6a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.175s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  804.893384] env[65478]: DEBUG oslo_concurrency.lockutils [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.581s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  804.893747] env[65478]: DEBUG oslo_concurrency.lockutils [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.984s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  804.896472] env[65478]: DEBUG nova.compute.manager [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  804.900034] env[65478]: DEBUG nova.objects.instance [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Lazy-loading 'resources' on Instance uuid b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  804.942465] env[65478]: DEBUG oslo_concurrency.lockutils [req-abcdbfca-c7cf-495f-baf4-9adfdce450a1 req-86e746ca-f337-46d0-80de-4cf4850b7451 service nova] Releasing lock "refresh_cache-eb076624-c76c-47da-9320-5fc13a51b365" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  805.168789] env[65478]: DEBUG oslo_concurrency.lockutils [req-adf517c2-dc1b-4b92-ac49-afcd357df99b req-03b54309-b439-4d89-a3fe-3e8531901c4d service nova] Releasing lock "refresh_cache-f0e88cef-300d-42a4-9cb6-843dc85da6a3" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  805.207980] env[65478]: DEBUG nova.compute.manager [req-726573d5-4791-41bd-b692-5c41a0ac1bbf req-82e0c96f-be04-477a-83cd-af81b33f2b29 service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Received event network-changed-457c1734-c99a-4d71-a200-0341a9e3bdd8 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  805.208932] env[65478]: DEBUG nova.compute.manager [req-726573d5-4791-41bd-b692-5c41a0ac1bbf req-82e0c96f-be04-477a-83cd-af81b33f2b29 service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Refreshing instance network info cache due to event network-changed-457c1734-c99a-4d71-a200-0341a9e3bdd8. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  805.209271] env[65478]: DEBUG oslo_concurrency.lockutils [req-726573d5-4791-41bd-b692-5c41a0ac1bbf req-82e0c96f-be04-477a-83cd-af81b33f2b29 service nova] Acquiring lock "refresh_cache-caf7856c-4e51-4e6c-ad32-2088e15d5d8f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  805.209396] env[65478]: DEBUG oslo_concurrency.lockutils [req-726573d5-4791-41bd-b692-5c41a0ac1bbf req-82e0c96f-be04-477a-83cd-af81b33f2b29 service nova] Acquired lock "refresh_cache-caf7856c-4e51-4e6c-ad32-2088e15d5d8f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  805.209528] env[65478]: DEBUG nova.network.neutron [req-726573d5-4791-41bd-b692-5c41a0ac1bbf req-82e0c96f-be04-477a-83cd-af81b33f2b29 service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Refreshing network info cache for port 457c1734-c99a-4d71-a200-0341a9e3bdd8 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  805.404388] env[65478]: DEBUG nova.compute.utils [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  805.405129] env[65478]: DEBUG nova.compute.manager [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  805.405279] env[65478]: DEBUG nova.network.neutron [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  805.406801] env[65478]: WARNING neutronclient.v2_0.client [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  805.406801] env[65478]: WARNING neutronclient.v2_0.client [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  805.416898] env[65478]: DEBUG nova.compute.manager [req-3fe7ad89-2c94-4eff-838d-85084cef0596 req-ce926c8d-7912-4345-9bfe-e18a9aec1eb7 service nova] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Received event network-vif-deleted-60d749ab-453c-414e-a511-3bb1b9f041d0 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  805.498173] env[65478]: DEBUG nova.policy [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4240f3ad2974fc7bbc969ca4f2b4752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f34d9b19c94478089fed931e391dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  805.563076] env[65478]: DEBUG nova.virt.hardware [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  805.563531] env[65478]: DEBUG nova.virt.hardware [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  805.563620] env[65478]: DEBUG nova.virt.hardware [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  805.564849] env[65478]: DEBUG nova.virt.hardware [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  805.566474] env[65478]: DEBUG nova.virt.hardware [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  805.566474] env[65478]: DEBUG nova.virt.hardware [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  805.566474] env[65478]: DEBUG nova.virt.hardware [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  805.566474] env[65478]: DEBUG nova.virt.hardware [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  805.566474] env[65478]: DEBUG nova.virt.hardware [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  805.566793] env[65478]: DEBUG nova.virt.hardware [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  805.566793] env[65478]: DEBUG nova.virt.hardware [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  805.569044] env[65478]: DEBUG oslo_vmware.service [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b40b748f-1d67-4909-b28f-632534fdc6cf {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  805.581524] env[65478]: DEBUG oslo_vmware.service [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a60ca61d-3d25-4b39-be15-c2d74a3538f7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  805.599042] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Instance VIF info [] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  805.607529] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  805.608204] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  805.608472] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-e5f23f8d-814a-4f51-a699-578b8251a976 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  805.636911] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  805.636911] env[65478]:    value = "task-6011714"
[  805.636911] env[65478]:    _type = "Task"
[  805.636911] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  805.648649] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011714, 'name': CreateVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  805.716025] env[65478]: WARNING neutronclient.v2_0.client [req-726573d5-4791-41bd-b692-5c41a0ac1bbf req-82e0c96f-be04-477a-83cd-af81b33f2b29 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  805.823222] env[65478]: DEBUG oslo_vmware.service [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9e4c438c-aab1-4f82-bdf6-9cf84a936ac5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  805.829735] env[65478]: DEBUG oslo_vmware.service [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0005f0f8-687b-4ef9-97af-ce14a1c07d55 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  805.865270] env[65478]: DEBUG oslo_vmware.service [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-90f4e181-2288-433c-a104-f5526c9c46f6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  805.873573] env[65478]: DEBUG oslo_vmware.service [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f0369b64-f912-4d7b-a97b-69c353643f5f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  805.891026] env[65478]: DEBUG nova.compute.provider_tree [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  805.912193] env[65478]: DEBUG nova.compute.manager [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  805.989595] env[65478]: DEBUG nova.network.neutron [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Successfully created port: 0c0d9e92-abc5-4d72-881a-e5bca5e8ff47 {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  806.147087] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011714, 'name': CreateVM_Task, 'duration_secs': 0.354313} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  806.147087] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  806.147565] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  806.147698] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  806.147996] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Acquired external semaphore "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  806.148357] env[65478]: DEBUG oslo_vmware.service [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-0b916cb4-257c-4715-b07f-fdcd9979b9c5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  806.154507] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Waiting for the task: (returnval){
[  806.154507] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52ebece1-ef32-6a37-2746-c61541627a02"
[  806.154507] env[65478]:    _type = "Task"
[  806.154507] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  806.163800] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52ebece1-ef32-6a37-2746-c61541627a02, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  806.392161] env[65478]: DEBUG nova.scheduler.client.report [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  806.665191] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52ebece1-ef32-6a37-2746-c61541627a02, 'name': SearchDatastore_Task, 'duration_secs': 0.010092} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  806.665725] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  806.665725] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  806.665821] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  806.665919] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  806.666065] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Creating directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  806.666340] env[65478]: DEBUG oslo_vmware.service [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-23d8b7af-01e7-4380-96b4-c38108230125 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  806.675482] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Created directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  806.675652] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Folder [datastore1] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  806.676440] env[65478]: DEBUG oslo_vmware.service [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-ba08299f-5185-4abe-b15c-e83f936470cd {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  806.681656] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Waiting for the task: (returnval){
[  806.681656] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]5200c198-e7c9-2673-7b60-680763f23fa7"
[  806.681656] env[65478]:    _type = "Task"
[  806.681656] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  806.690455] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5200c198-e7c9-2673-7b60-680763f23fa7, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  806.899125] env[65478]: DEBUG oslo_concurrency.lockutils [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.007s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  806.904376] env[65478]: DEBUG oslo_concurrency.lockutils [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 4.989s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  806.904376] env[65478]: DEBUG nova.objects.instance [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Lazy-loading 'resources' on Instance uuid 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  806.925558] env[65478]: INFO nova.scheduler.client.report [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Deleted allocations for instance b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f
[  806.928997] env[65478]: DEBUG nova.compute.manager [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  806.971017] env[65478]: DEBUG nova.virt.hardware [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  806.971735] env[65478]: DEBUG nova.virt.hardware [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  806.971921] env[65478]: DEBUG nova.virt.hardware [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  806.972163] env[65478]: DEBUG nova.virt.hardware [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  806.972317] env[65478]: DEBUG nova.virt.hardware [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  806.972474] env[65478]: DEBUG nova.virt.hardware [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  806.972728] env[65478]: DEBUG nova.virt.hardware [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  806.972898] env[65478]: DEBUG nova.virt.hardware [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  806.973095] env[65478]: DEBUG nova.virt.hardware [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  806.973276] env[65478]: DEBUG nova.virt.hardware [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  806.973464] env[65478]: DEBUG nova.virt.hardware [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  806.974915] env[65478]: DEBUG oslo_vmware.service [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a50232e5-2b8e-49f8-88e2-b7900b36cfaa {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  806.990015] env[65478]: DEBUG oslo_vmware.service [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0fc2635f-82e0-430b-bf10-9db98e62d37f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  807.727868] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5200c198-e7c9-2673-7b60-680763f23fa7, 'name': SearchDatastore_Task, 'duration_secs': 0.009521} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  807.737569] env[65478]: DEBUG oslo_vmware.service [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-40da4db5-5f48-42f9-a57f-9cb218254fd1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  807.818959] env[65478]: DEBUG nova.network.neutron [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Successfully updated port: 0c0d9e92-abc5-4d72-881a-e5bca5e8ff47 {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  807.822414] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Waiting for the task: (returnval){
[  807.822414] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]521d8e5a-f4e0-00f2-784a-d592f3cdf593"
[  807.822414] env[65478]:    _type = "Task"
[  807.822414] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  807.834337] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]521d8e5a-f4e0-00f2-784a-d592f3cdf593, 'name': SearchDatastore_Task, 'duration_secs': 0.009812} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  807.834551] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  807.834807] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Copying Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3/4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  807.835099] env[65478]: DEBUG oslo_vmware.service [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-cd47bd4e-28af-44fe-923d-1b151e7ef701 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  807.845064] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Waiting for the task: (returnval){
[  807.845064] env[65478]:    value = "task-6011715"
[  807.845064] env[65478]:    _type = "Task"
[  807.845064] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  807.858374] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011715, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  808.157065] env[65478]: DEBUG oslo_vmware.service [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a3bd68d0-8686-48f8-842e-83b3c0481119 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  808.166453] env[65478]: DEBUG oslo_vmware.service [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8d268d93-a42d-4495-953c-60f71e8b889c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  808.213201] env[65478]: DEBUG oslo_vmware.service [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-312f4dfc-ef40-4b6d-be59-6901a325706a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  808.222431] env[65478]: DEBUG oslo_vmware.service [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-18bfa566-bc40-4583-b903-41e360ac4944 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  808.235755] env[65478]: DEBUG oslo_concurrency.lockutils [None req-5fbe0d0a-7cd9-4944-890e-9d409a56b551 tempest-InstanceActionsV221TestJSON-1037432953 tempest-InstanceActionsV221TestJSON-1037432953-project-member] Lock "b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.155s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  808.247727] env[65478]: DEBUG nova.compute.provider_tree [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  808.331680] env[65478]: DEBUG oslo_concurrency.lockutils [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Acquiring lock "refresh_cache-6f6c4cda-9439-47dd-810c-25b0516585e6" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  808.331680] env[65478]: DEBUG oslo_concurrency.lockutils [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Acquired lock "refresh_cache-6f6c4cda-9439-47dd-810c-25b0516585e6" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  808.331680] env[65478]: DEBUG nova.network.neutron [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  808.365481] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011715, 'name': CopyVirtualDisk_Task} progress is 100%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  808.653895] env[65478]: WARNING neutronclient.v2_0.client [req-726573d5-4791-41bd-b692-5c41a0ac1bbf req-82e0c96f-be04-477a-83cd-af81b33f2b29 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  808.752190] env[65478]: DEBUG nova.scheduler.client.report [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  808.857496] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "f37353fc-a5c5-41db-9d2c-c1f286fe321b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  808.858084] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "f37353fc-a5c5-41db-9d2c-c1f286fe321b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  808.863629] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011715, 'name': CopyVirtualDisk_Task} progress is 100%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  808.869194] env[65478]: DEBUG nova.network.neutron [req-726573d5-4791-41bd-b692-5c41a0ac1bbf req-82e0c96f-be04-477a-83cd-af81b33f2b29 service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Updated VIF entry in instance network info cache for port 457c1734-c99a-4d71-a200-0341a9e3bdd8. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  808.869531] env[65478]: DEBUG nova.network.neutron [req-726573d5-4791-41bd-b692-5c41a0ac1bbf req-82e0c96f-be04-477a-83cd-af81b33f2b29 service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Updating instance_info_cache with network_info: [{"id": "457c1734-c99a-4d71-a200-0341a9e3bdd8", "address": "fa:16:3e:90:77:31", "network": {"id": "eab0e877-79ef-45b8-a26f-7dd517a13b53", "bridge": "br-int", "label": "tempest-FloatingIPsAssociationTestJSON-364284774-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "7dd8c4cd35c44466b1991950f28d886b", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "054fcd1e-638e-425a-a1de-78cb188ae026", "external-id": "nsx-vlan-transportzone-658", "segmentation_id": 658, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap457c1734-c9", "ovs_interfaceid": "457c1734-c99a-4d71-a200-0341a9e3bdd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  808.967029] env[65478]: DEBUG nova.network.neutron [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  809.258759] env[65478]: DEBUG oslo_concurrency.lockutils [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.355s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  809.262157] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 6.925s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  809.262157] env[65478]: DEBUG nova.objects.instance [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Lazy-loading 'resources' on Instance uuid 230cc05f-433e-4510-947f-35466335662d {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  809.299166] env[65478]: INFO nova.scheduler.client.report [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Deleted allocations for instance 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc
[  809.310519] env[65478]: WARNING neutronclient.v2_0.client [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  809.361058] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011715, 'name': CopyVirtualDisk_Task, 'duration_secs': 1.489997} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  809.361058] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Copied Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3/4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  809.361277] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  809.362031] env[65478]: DEBUG oslo_vmware.service [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-c6bda29c-40ca-4594-883d-1ebeea8642fe {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  809.365629] env[65478]: DEBUG nova.compute.manager [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  809.370850] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Waiting for the task: (returnval){
[  809.370850] env[65478]:    value = "task-6011716"
[  809.370850] env[65478]:    _type = "Task"
[  809.370850] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  809.377113] env[65478]: DEBUG oslo_concurrency.lockutils [req-726573d5-4791-41bd-b692-5c41a0ac1bbf req-82e0c96f-be04-477a-83cd-af81b33f2b29 service nova] Releasing lock "refresh_cache-caf7856c-4e51-4e6c-ad32-2088e15d5d8f" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  809.380449] env[65478]: DEBUG nova.compute.manager [req-726573d5-4791-41bd-b692-5c41a0ac1bbf req-82e0c96f-be04-477a-83cd-af81b33f2b29 service nova] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Received event network-vif-deleted-69013773-3f93-4432-9c5b-6726964a77d9 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  809.381133] env[65478]: DEBUG nova.compute.manager [req-726573d5-4791-41bd-b692-5c41a0ac1bbf req-82e0c96f-be04-477a-83cd-af81b33f2b29 service nova] [instance: 230cc05f-433e-4510-947f-35466335662d] Received event network-vif-deleted-985b51bf-6e77-4d08-af82-c5fd27868326 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  809.381377] env[65478]: DEBUG nova.compute.manager [req-726573d5-4791-41bd-b692-5c41a0ac1bbf req-82e0c96f-be04-477a-83cd-af81b33f2b29 service nova] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Received event network-vif-deleted-e599424e-fe74-4d2c-948c-3759b6289f44 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  809.386563] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011716, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  809.514175] env[65478]: DEBUG nova.network.neutron [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Updating instance_info_cache with network_info: [{"id": "0c0d9e92-abc5-4d72-881a-e5bca5e8ff47", "address": "fa:16:3e:08:d3:02", "network": {"id": "8419dcc5-ccb7-4667-a5ee-3f07016ddecd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "eb20b7ec77e847179c9940510a8b48bf", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "ec3f9e71-839a-429d-b211-d3dfc98ca4f6", "external-id": "nsx-vlan-transportzone-5", "segmentation_id": 5, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap0c0d9e92-ab", "ovs_interfaceid": "0c0d9e92-abc5-4d72-881a-e5bca5e8ff47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  809.810033] env[65478]: DEBUG oslo_concurrency.lockutils [None req-732f8cdb-c3d1-4b93-a53c-3546865b99c0 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Lock "6ef7bbde-0ba8-44a9-8643-e674a14f3cbc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.796s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  809.882418] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011716, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.073712} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  809.886947] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  809.887842] env[65478]: DEBUG oslo_vmware.service [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6d273c04-2e70-4347-8adb-9a02b5d4f900 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  809.918269] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  809.928787] env[65478]: DEBUG nova.compute.manager [req-75385c23-705b-45ad-a855-85694a56f602 req-7efb11b1-85ed-4395-a61c-2a1f89015f81 service nova] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Received event network-changed-fc5c04e7-8dac-4f1f-a5e4-9f9d31498143 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  809.928948] env[65478]: DEBUG nova.compute.manager [req-75385c23-705b-45ad-a855-85694a56f602 req-7efb11b1-85ed-4395-a61c-2a1f89015f81 service nova] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Refreshing instance network info cache due to event network-changed-fc5c04e7-8dac-4f1f-a5e4-9f9d31498143. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  809.940817] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Reconfiguring VM instance instance-00000016 to attach disk [datastore1] 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3/4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  809.941478] env[65478]: DEBUG oslo_concurrency.lockutils [req-75385c23-705b-45ad-a855-85694a56f602 req-7efb11b1-85ed-4395-a61c-2a1f89015f81 service nova] Acquiring lock "refresh_cache-9b286a00-af27-4012-a596-45bbe98da254" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  809.942386] env[65478]: DEBUG oslo_vmware.service [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-97c81225-c62a-4298-a8a3-322ffdd44d82 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  809.948624] env[65478]: DEBUG oslo_concurrency.lockutils [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Acquiring lock "e9f84a20-8def-4f36-92eb-8625364f7024" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  809.966034] env[65478]: DEBUG oslo_concurrency.lockutils [req-75385c23-705b-45ad-a855-85694a56f602 req-7efb11b1-85ed-4395-a61c-2a1f89015f81 service nova] Acquired lock "refresh_cache-9b286a00-af27-4012-a596-45bbe98da254" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  809.966563] env[65478]: DEBUG nova.network.neutron [req-75385c23-705b-45ad-a855-85694a56f602 req-7efb11b1-85ed-4395-a61c-2a1f89015f81 service nova] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Refreshing network info cache for port fc5c04e7-8dac-4f1f-a5e4-9f9d31498143 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  809.969998] env[65478]: DEBUG oslo_concurrency.lockutils [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Lock "e9f84a20-8def-4f36-92eb-8625364f7024" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.019s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  809.976569] env[65478]: DEBUG nova.compute.manager [req-358d5b91-aba3-400e-b2da-86e025b91e53 req-8b9f62cf-45dc-4b8e-a74b-6dcb78e340c5 service nova] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Received event network-vif-plugged-0c0d9e92-abc5-4d72-881a-e5bca5e8ff47 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  809.977381] env[65478]: DEBUG oslo_concurrency.lockutils [req-358d5b91-aba3-400e-b2da-86e025b91e53 req-8b9f62cf-45dc-4b8e-a74b-6dcb78e340c5 service nova] Acquiring lock "6f6c4cda-9439-47dd-810c-25b0516585e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  809.978164] env[65478]: DEBUG oslo_concurrency.lockutils [req-358d5b91-aba3-400e-b2da-86e025b91e53 req-8b9f62cf-45dc-4b8e-a74b-6dcb78e340c5 service nova] Lock "6f6c4cda-9439-47dd-810c-25b0516585e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  809.980901] env[65478]: DEBUG oslo_concurrency.lockutils [req-358d5b91-aba3-400e-b2da-86e025b91e53 req-8b9f62cf-45dc-4b8e-a74b-6dcb78e340c5 service nova] Lock "6f6c4cda-9439-47dd-810c-25b0516585e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  809.982453] env[65478]: DEBUG nova.compute.manager [req-358d5b91-aba3-400e-b2da-86e025b91e53 req-8b9f62cf-45dc-4b8e-a74b-6dcb78e340c5 service nova] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] No waiting events found dispatching network-vif-plugged-0c0d9e92-abc5-4d72-881a-e5bca5e8ff47 {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  809.984272] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Waiting for the task: (returnval){
[  809.984272] env[65478]:    value = "task-6011717"
[  809.984272] env[65478]:    _type = "Task"
[  809.984272] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  809.995886] env[65478]: WARNING nova.compute.manager [req-358d5b91-aba3-400e-b2da-86e025b91e53 req-8b9f62cf-45dc-4b8e-a74b-6dcb78e340c5 service nova] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Received unexpected event network-vif-plugged-0c0d9e92-abc5-4d72-881a-e5bca5e8ff47 for instance with vm_state building and task_state spawning.
[  810.009407] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011717, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  810.018688] env[65478]: DEBUG oslo_concurrency.lockutils [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Releasing lock "refresh_cache-6f6c4cda-9439-47dd-810c-25b0516585e6" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  810.018688] env[65478]: DEBUG nova.compute.manager [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Instance network_info: |[{"id": "0c0d9e92-abc5-4d72-881a-e5bca5e8ff47", "address": "fa:16:3e:08:d3:02", "network": {"id": "8419dcc5-ccb7-4667-a5ee-3f07016ddecd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "eb20b7ec77e847179c9940510a8b48bf", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "ec3f9e71-839a-429d-b211-d3dfc98ca4f6", "external-id": "nsx-vlan-transportzone-5", "segmentation_id": 5, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap0c0d9e92-ab", "ovs_interfaceid": "0c0d9e92-abc5-4d72-881a-e5bca5e8ff47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  810.020198] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:08:d3:02', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': 'ec3f9e71-839a-429d-b211-d3dfc98ca4f6', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': '0c0d9e92-abc5-4d72-881a-e5bca5e8ff47', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  810.040358] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Creating folder: Project (9f34d9b19c94478089fed931e391dfb7). Parent ref: group-v1161186. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  810.040806] env[65478]: DEBUG oslo_vmware.service [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-8504b75a-173d-4d2d-b444-db9ad636a88a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  810.049805] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Created folder: Project (9f34d9b19c94478089fed931e391dfb7) in parent group-v1161186.
[  810.049970] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Creating folder: Instances. Parent ref: group-v1161267. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  810.050324] env[65478]: DEBUG oslo_vmware.service [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-e3dbdf86-6839-4959-9f4a-8227ddee366c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  810.058519] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Created folder: Instances in parent group-v1161267.
[  810.059794] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  810.060315] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  810.060610] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-51905765-c512-4f3b-89bb-7054a9a59855 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  810.085054] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  810.085054] env[65478]:    value = "task-6011720"
[  810.085054] env[65478]:    _type = "Task"
[  810.085054] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  810.096734] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011720, 'name': CreateVM_Task} progress is 5%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  810.228655] env[65478]: DEBUG oslo_vmware.service [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-70681caf-c727-45d9-8250-5e1f164c22b4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  810.236691] env[65478]: DEBUG oslo_vmware.service [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3a7f7a3e-681e-4600-b00d-bc65cbb5a317 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  810.272590] env[65478]: DEBUG oslo_vmware.service [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6caaa258-d8c2-4861-9cf7-0bc717e7a84e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  810.284411] env[65478]: DEBUG oslo_vmware.service [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-30650ba3-d395-4c80-9f3d-6c297dbaaca5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  810.303174] env[65478]: DEBUG nova.compute.provider_tree [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  810.473934] env[65478]: WARNING neutronclient.v2_0.client [req-75385c23-705b-45ad-a855-85694a56f602 req-7efb11b1-85ed-4395-a61c-2a1f89015f81 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  810.482747] env[65478]: DEBUG nova.compute.manager [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  810.502597] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011717, 'name': ReconfigVM_Task, 'duration_secs': 0.295956} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  810.502845] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Reconfigured VM instance instance-00000016 to attach disk [datastore1] 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3/4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  810.507043] env[65478]: DEBUG oslo_vmware.service [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-28363bd8-80f5-430e-be3c-a4d3ad693599 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  810.513168] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Waiting for the task: (returnval){
[  810.513168] env[65478]:    value = "task-6011721"
[  810.513168] env[65478]:    _type = "Task"
[  810.513168] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  810.526037] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011721, 'name': Rename_Task} progress is 10%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  810.607116] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011720, 'name': CreateVM_Task, 'duration_secs': 0.338955} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  810.607514] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  810.608141] env[65478]: WARNING neutronclient.v2_0.client [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  810.608556] env[65478]: DEBUG oslo_concurrency.lockutils [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  810.608710] env[65478]: DEBUG oslo_concurrency.lockutils [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  810.609062] env[65478]: DEBUG oslo_concurrency.lockutils [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Acquired external semaphore "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  810.609990] env[65478]: DEBUG oslo_vmware.service [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-7077e35a-ffb1-475d-8cb8-8a787d6bbdfe {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  810.616110] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Waiting for the task: (returnval){
[  810.616110] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]521c0656-3915-98a4-98fd-670a5b9a63ea"
[  810.616110] env[65478]:    _type = "Task"
[  810.616110] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  810.629301] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]521c0656-3915-98a4-98fd-670a5b9a63ea, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  810.699306] env[65478]: WARNING neutronclient.v2_0.client [req-75385c23-705b-45ad-a855-85694a56f602 req-7efb11b1-85ed-4395-a61c-2a1f89015f81 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  810.778327] env[65478]: DEBUG nova.network.neutron [req-75385c23-705b-45ad-a855-85694a56f602 req-7efb11b1-85ed-4395-a61c-2a1f89015f81 service nova] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Updated VIF entry in instance network info cache for port fc5c04e7-8dac-4f1f-a5e4-9f9d31498143. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  810.782046] env[65478]: DEBUG nova.network.neutron [req-75385c23-705b-45ad-a855-85694a56f602 req-7efb11b1-85ed-4395-a61c-2a1f89015f81 service nova] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Updating instance_info_cache with network_info: [{"id": "fc5c04e7-8dac-4f1f-a5e4-9f9d31498143", "address": "fa:16:3e:17:84:6e", "network": {"id": "7cd93ed0-202b-4b24-a579-dd5eacc8ea60", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140861423-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "10.180.180.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "3c6c9b0fcb1f453a8108522a8924bda3", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "d4345ef6-a7c8-4c1c-badf-a0d4f578b61c", "external-id": "nsx-vlan-transportzone-677", "segmentation_id": 677, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapfc5c04e7-8d", "ovs_interfaceid": "fc5c04e7-8dac-4f1f-a5e4-9f9d31498143", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  810.790201] env[65478]: DEBUG oslo_concurrency.lockutils [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Acquiring lock "4f7fb80a-cb05-4bd5-bb10-380d95b2e892" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  810.790402] env[65478]: DEBUG oslo_concurrency.lockutils [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Lock "4f7fb80a-cb05-4bd5-bb10-380d95b2e892" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  810.790587] env[65478]: DEBUG oslo_concurrency.lockutils [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Acquiring lock "4f7fb80a-cb05-4bd5-bb10-380d95b2e892-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  810.790711] env[65478]: DEBUG oslo_concurrency.lockutils [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Lock "4f7fb80a-cb05-4bd5-bb10-380d95b2e892-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  810.790977] env[65478]: DEBUG oslo_concurrency.lockutils [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Lock "4f7fb80a-cb05-4bd5-bb10-380d95b2e892-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  810.793339] env[65478]: INFO nova.compute.manager [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Terminating instance
[  810.811779] env[65478]: DEBUG nova.scheduler.client.report [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  811.024290] env[65478]: DEBUG oslo_concurrency.lockutils [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  811.027907] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011721, 'name': Rename_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  811.128483] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]521c0656-3915-98a4-98fd-670a5b9a63ea, 'name': SearchDatastore_Task, 'duration_secs': 0.009881} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  811.128902] env[65478]: DEBUG oslo_concurrency.lockutils [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  811.132258] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  811.132258] env[65478]: DEBUG oslo_concurrency.lockutils [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  811.132258] env[65478]: DEBUG oslo_concurrency.lockutils [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  811.132258] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Creating directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  811.132424] env[65478]: DEBUG oslo_vmware.service [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-3d79cba7-ef35-4143-904c-4bea5ab357be {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  811.142210] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Created directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  811.142210] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Folder [datastore1] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  811.142210] env[65478]: DEBUG oslo_vmware.service [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-3217c211-5602-4170-a2bf-de5fe3d08f5c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  811.148306] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Waiting for the task: (returnval){
[  811.148306] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c1283d-8da0-e077-6abc-8c2aafcde49a"
[  811.148306] env[65478]:    _type = "Task"
[  811.148306] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  811.157652] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c1283d-8da0-e077-6abc-8c2aafcde49a, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  811.285130] env[65478]: DEBUG oslo_concurrency.lockutils [req-75385c23-705b-45ad-a855-85694a56f602 req-7efb11b1-85ed-4395-a61c-2a1f89015f81 service nova] Releasing lock "refresh_cache-9b286a00-af27-4012-a596-45bbe98da254" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  811.296901] env[65478]: DEBUG nova.compute.manager [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[  811.296948] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  811.297933] env[65478]: DEBUG oslo_vmware.service [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-811d1212-1c7d-478f-96f4-f02a2b223a72 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  811.307264] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  811.307601] env[65478]: DEBUG oslo_vmware.service [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-24188be3-5d9e-4605-abcc-ead8097f7dd2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  811.318211] env[65478]: DEBUG oslo_vmware.api [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Waiting for the task: (returnval){
[  811.318211] env[65478]:    value = "task-6011722"
[  811.318211] env[65478]:    _type = "Task"
[  811.318211] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  811.325529] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.066s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  811.330683] env[65478]: DEBUG oslo_concurrency.lockutils [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 8.700s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  811.330996] env[65478]: DEBUG nova.objects.instance [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Lazy-loading 'resources' on Instance uuid 4821048b-4b5a-40b5-8888-f00dd28425d1 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  811.333829] env[65478]: DEBUG oslo_vmware.api [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011722, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  811.369866] env[65478]: INFO nova.scheduler.client.report [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Deleted allocations for instance 230cc05f-433e-4510-947f-35466335662d
[  811.528516] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011721, 'name': Rename_Task, 'duration_secs': 0.962449} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  811.528781] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  811.530801] env[65478]: DEBUG oslo_vmware.service [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-55973b7e-9b34-41fc-b40d-777a992f25af {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  811.535303] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Waiting for the task: (returnval){
[  811.535303] env[65478]:    value = "task-6011723"
[  811.535303] env[65478]:    _type = "Task"
[  811.535303] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  811.547770] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011723, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  811.559579] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Acquiring lock "caf7856c-4e51-4e6c-ad32-2088e15d5d8f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  811.559579] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Lock "caf7856c-4e51-4e6c-ad32-2088e15d5d8f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  811.559579] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Acquiring lock "caf7856c-4e51-4e6c-ad32-2088e15d5d8f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  811.559819] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Lock "caf7856c-4e51-4e6c-ad32-2088e15d5d8f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  811.559903] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Lock "caf7856c-4e51-4e6c-ad32-2088e15d5d8f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  811.562428] env[65478]: INFO nova.compute.manager [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Terminating instance
[  811.662282] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c1283d-8da0-e077-6abc-8c2aafcde49a, 'name': SearchDatastore_Task, 'duration_secs': 0.009382} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  811.663248] env[65478]: DEBUG oslo_vmware.service [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-d59224fd-f01c-44f2-8d4b-aadf398b0dd1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  811.669276] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Waiting for the task: (returnval){
[  811.669276] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]524a993d-a91a-8260-5106-8be50e53317f"
[  811.669276] env[65478]:    _type = "Task"
[  811.669276] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  811.681548] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]524a993d-a91a-8260-5106-8be50e53317f, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  811.711515] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Acquiring lock "28200981-9217-4395-b0a8-c154624c7a1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  811.711627] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Lock "28200981-9217-4395-b0a8-c154624c7a1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  811.830112] env[65478]: DEBUG oslo_vmware.api [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011722, 'name': PowerOffVM_Task, 'duration_secs': 0.338681} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  811.830112] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  811.830112] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  811.830404] env[65478]: DEBUG oslo_vmware.service [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-6d9a4124-aec3-448f-809d-8ddc9cae58d1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  811.878986] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0f546bb1-ac25-4a6a-93d5-f165707d321f tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Lock "230cc05f-433e-4510-947f-35466335662d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.505s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  811.890725] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  811.890890] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Deleting contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  811.891057] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Deleting the datastore file [datastore1] 4f7fb80a-cb05-4bd5-bb10-380d95b2e892 {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  811.892528] env[65478]: DEBUG oslo_vmware.service [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-13b434a1-7d92-41d9-bb35-4d8ea47f9c21 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  811.897823] env[65478]: DEBUG oslo_vmware.api [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Waiting for the task: (returnval){
[  811.897823] env[65478]:    value = "task-6011725"
[  811.897823] env[65478]:    _type = "Task"
[  811.897823] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  811.912960] env[65478]: DEBUG oslo_vmware.api [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011725, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  812.046940] env[65478]: DEBUG oslo_vmware.api [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011723, 'name': PowerOnVM_Task, 'duration_secs': 0.478135} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  812.050784] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  812.050784] env[65478]: DEBUG nova.compute.manager [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  812.053055] env[65478]: DEBUG oslo_vmware.service [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-da85e6dd-1173-43ed-b1bc-1c4587b250a9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  812.070691] env[65478]: DEBUG nova.compute.manager [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[  812.071669] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  812.073084] env[65478]: DEBUG oslo_vmware.service [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-dfd792a9-4f98-47bc-ad9e-65fe55150e68 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  812.087428] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  812.090781] env[65478]: DEBUG oslo_vmware.service [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-28c969be-0265-41e5-961e-bc6dbec4570d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  812.097640] env[65478]: DEBUG oslo_vmware.api [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for the task: (returnval){
[  812.097640] env[65478]:    value = "task-6011726"
[  812.097640] env[65478]:    _type = "Task"
[  812.097640] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  812.110421] env[65478]: DEBUG oslo_vmware.api [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011726, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  812.181046] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]524a993d-a91a-8260-5106-8be50e53317f, 'name': SearchDatastore_Task, 'duration_secs': 0.009302} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  812.181999] env[65478]: DEBUG oslo_concurrency.lockutils [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  812.181999] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Copying Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 6f6c4cda-9439-47dd-810c-25b0516585e6/6f6c4cda-9439-47dd-810c-25b0516585e6.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  812.181999] env[65478]: DEBUG oslo_vmware.service [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-5244b5f2-9138-49c9-b0f7-13ba102e5bd6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  812.188966] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Waiting for the task: (returnval){
[  812.188966] env[65478]:    value = "task-6011727"
[  812.188966] env[65478]:    _type = "Task"
[  812.188966] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  812.200308] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011727, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  812.214528] env[65478]: DEBUG nova.compute.manager [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  812.240656] env[65478]: DEBUG oslo_vmware.service [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-5d1a36f9-8bc2-4dc5-8502-cc754b211934 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  812.252427] env[65478]: DEBUG oslo_vmware.service [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-83adbe3c-4dd5-4a0a-93bc-d6ac432686fb {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  812.290622] env[65478]: DEBUG oslo_vmware.service [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-28328cc3-137e-4518-8d01-300553c875e5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  812.299960] env[65478]: DEBUG oslo_vmware.service [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-efba7eca-18f3-4e88-910d-4235ef532b23 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  812.318379] env[65478]: DEBUG nova.compute.provider_tree [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  812.409678] env[65478]: DEBUG oslo_vmware.api [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011725, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.150534} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  812.409678] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  812.409678] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Deleted contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  812.409678] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  812.409678] env[65478]: INFO nova.compute.manager [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Took 1.11 seconds to destroy the instance on the hypervisor.
[  812.410485] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  812.410683] env[65478]: DEBUG nova.compute.manager [-] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[  812.410774] env[65478]: DEBUG nova.network.neutron [-] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[  812.411060] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  812.560419] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  812.565433] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Acquiring lock "eb076624-c76c-47da-9320-5fc13a51b365" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  812.565433] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Lock "eb076624-c76c-47da-9320-5fc13a51b365" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  812.565433] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Acquiring lock "eb076624-c76c-47da-9320-5fc13a51b365-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  812.565690] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Lock "eb076624-c76c-47da-9320-5fc13a51b365-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  812.565690] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Lock "eb076624-c76c-47da-9320-5fc13a51b365-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  812.571278] env[65478]: INFO nova.compute.manager [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Terminating instance
[  812.580357] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  812.612231] env[65478]: DEBUG oslo_vmware.api [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011726, 'name': PowerOffVM_Task, 'duration_secs': 0.227153} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  812.612464] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  812.613152] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  812.613765] env[65478]: DEBUG oslo_vmware.service [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-15ad3276-2f2b-45ba-9bd1-e1edabf2393d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  812.686281] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  812.686281] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Deleting contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  812.686281] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Deleting the datastore file [datastore1] caf7856c-4e51-4e6c-ad32-2088e15d5d8f {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  812.686281] env[65478]: DEBUG oslo_vmware.service [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-c8a10197-09d0-4073-80bd-41d96effd186 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  812.699483] env[65478]: DEBUG oslo_vmware.api [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for the task: (returnval){
[  812.699483] env[65478]:    value = "task-6011729"
[  812.699483] env[65478]:    _type = "Task"
[  812.699483] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  812.711120] env[65478]: DEBUG oslo_vmware.api [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011729, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  812.715054] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011727, 'name': CopyVirtualDisk_Task} progress is 77%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  812.748199] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  812.823723] env[65478]: DEBUG nova.scheduler.client.report [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  813.080779] env[65478]: DEBUG nova.compute.manager [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[  813.081519] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  813.083770] env[65478]: DEBUG oslo_vmware.service [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c10d33d5-33fb-407a-b884-dd7881e4ca6c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  813.096587] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  813.096758] env[65478]: DEBUG oslo_vmware.service [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-7ec4aade-a519-4efd-a2ad-18010e7271de {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  813.103890] env[65478]: DEBUG oslo_vmware.api [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Waiting for the task: (returnval){
[  813.103890] env[65478]:    value = "task-6011730"
[  813.103890] env[65478]:    _type = "Task"
[  813.103890] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  813.114211] env[65478]: DEBUG oslo_vmware.api [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Task: {'id': task-6011730, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  813.210702] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011727, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.539783} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  813.211160] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Copied Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 6f6c4cda-9439-47dd-810c-25b0516585e6/6f6c4cda-9439-47dd-810c-25b0516585e6.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  813.212190] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  813.215939] env[65478]: DEBUG oslo_vmware.api [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Task: {'id': task-6011729, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.157349} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  813.216200] env[65478]: DEBUG oslo_vmware.service [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-fe6dd6f5-901a-4170-95b0-f41705826375 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  813.218613] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  813.219151] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Deleted contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  813.219151] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  813.219151] env[65478]: INFO nova.compute.manager [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Took 1.15 seconds to destroy the instance on the hypervisor.
[  813.219781] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  813.220132] env[65478]: DEBUG nova.compute.manager [-] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[  813.220346] env[65478]: DEBUG nova.network.neutron [-] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[  813.220624] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  813.223826] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Waiting for the task: (returnval){
[  813.223826] env[65478]:    value = "task-6011731"
[  813.223826] env[65478]:    _type = "Task"
[  813.223826] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  813.233091] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011731, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  813.332336] env[65478]: DEBUG oslo_concurrency.lockutils [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.006s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  813.334347] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 10.002s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  813.338375] env[65478]: INFO nova.compute.claims [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  813.379895] env[65478]: INFO nova.scheduler.client.report [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Deleted allocations for instance 4821048b-4b5a-40b5-8888-f00dd28425d1
[  813.614456] env[65478]: DEBUG oslo_vmware.api [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Task: {'id': task-6011730, 'name': PowerOffVM_Task, 'duration_secs': 0.235462} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  813.614844] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  813.614974] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  813.615331] env[65478]: DEBUG oslo_vmware.service [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-7667ff72-ce38-4c97-ba4e-301a6215282f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  813.685301] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  813.685466] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Deleting contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  813.686177] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Deleting the datastore file [datastore1] eb076624-c76c-47da-9320-5fc13a51b365 {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  813.686288] env[65478]: DEBUG oslo_vmware.service [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-0bc9bf01-9f27-4844-abf1-a618e6ea67a9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  813.697270] env[65478]: DEBUG oslo_vmware.api [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Waiting for the task: (returnval){
[  813.697270] env[65478]:    value = "task-6011733"
[  813.697270] env[65478]:    _type = "Task"
[  813.697270] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  813.706038] env[65478]: DEBUG oslo_vmware.api [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Task: {'id': task-6011733, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  813.746196] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011731, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.073352} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  813.746587] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  813.747933] env[65478]: DEBUG oslo_vmware.service [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8676a713-3f50-49ad-8e60-e874c25c6e16 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  813.777490] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Reconfiguring VM instance instance-0000001c to attach disk [datastore1] 6f6c4cda-9439-47dd-810c-25b0516585e6/6f6c4cda-9439-47dd-810c-25b0516585e6.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  813.778122] env[65478]: DEBUG oslo_vmware.service [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-785aa5ad-4318-4b26-a7f5-a7d7a46e97cc {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  813.801396] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Waiting for the task: (returnval){
[  813.801396] env[65478]:    value = "task-6011734"
[  813.801396] env[65478]:    _type = "Task"
[  813.801396] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  813.809659] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011734, 'name': ReconfigVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  813.881022] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  813.894370] env[65478]: DEBUG oslo_concurrency.lockutils [None req-abfb3cb1-62a5-48ec-8547-2ba1c9817b46 tempest-InstanceActionsTestJSON-1806747380 tempest-InstanceActionsTestJSON-1806747380-project-member] Lock "4821048b-4b5a-40b5-8888-f00dd28425d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.408s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  814.157812] env[65478]: DEBUG nova.network.neutron [-] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  814.212726] env[65478]: DEBUG oslo_vmware.api [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Task: {'id': task-6011733, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.14352} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  814.213654] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  814.213654] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Deleted contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  814.213842] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  814.214165] env[65478]: INFO nova.compute.manager [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Took 1.13 seconds to destroy the instance on the hypervisor.
[  814.214695] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  814.215038] env[65478]: DEBUG nova.compute.manager [-] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[  814.215154] env[65478]: DEBUG nova.network.neutron [-] [instance: eb076624-c76c-47da-9320-5fc13a51b365] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[  814.215417] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  814.314808] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011734, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  814.660788] env[65478]: INFO nova.compute.manager [-] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Took 2.25 seconds to deallocate network for instance.
[  814.707601] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  814.746176] env[65478]: DEBUG oslo_vmware.service [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d2cb73e5-d4ca-4667-959b-4b153ff05f7c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  814.762490] env[65478]: DEBUG oslo_vmware.service [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c70d72ea-4382-426a-82e4-2b33c4e30a1d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  814.795852] env[65478]: DEBUG oslo_vmware.service [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f3225d50-014c-498f-9abd-c66686275d5c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  814.810069] env[65478]: DEBUG oslo_vmware.service [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-12c1fb73-1277-4704-8fa4-acdb219eaf56 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  814.828556] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011734, 'name': ReconfigVM_Task, 'duration_secs': 0.572044} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  814.831545] env[65478]: DEBUG nova.compute.provider_tree [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  814.832710] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Reconfigured VM instance instance-0000001c to attach disk [datastore1] 6f6c4cda-9439-47dd-810c-25b0516585e6/6f6c4cda-9439-47dd-810c-25b0516585e6.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  814.833657] env[65478]: DEBUG oslo_vmware.service [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-02849de8-5988-4db4-b94e-8de9aae6f4d8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  814.841375] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Waiting for the task: (returnval){
[  814.841375] env[65478]:    value = "task-6011739"
[  814.841375] env[65478]:    _type = "Task"
[  814.841375] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  814.851849] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011739, 'name': Rename_Task} progress is 5%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  814.871190] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Acquiring lock "ef569806-5f50-44b9-a4a9-0107328a8dfe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  814.871190] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Lock "ef569806-5f50-44b9-a4a9-0107328a8dfe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  815.062802] env[65478]: DEBUG nova.network.neutron [-] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  815.175328] env[65478]: DEBUG oslo_concurrency.lockutils [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  815.335149] env[65478]: DEBUG nova.scheduler.client.report [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  815.355115] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011739, 'name': Rename_Task} progress is 99%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  815.374483] env[65478]: DEBUG nova.compute.manager [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  815.566824] env[65478]: INFO nova.compute.manager [-] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Took 2.35 seconds to deallocate network for instance.
[  815.594188] env[65478]: DEBUG nova.compute.manager [req-44749b66-015e-4e31-afe1-60e91a07bac4 req-b210d24b-0e28-4c47-83a8-4e9fd4a159df service nova] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Received event network-changed-fb55a6bb-2879-44ea-b228-fe4609c36e10 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  815.595614] env[65478]: DEBUG nova.compute.manager [req-44749b66-015e-4e31-afe1-60e91a07bac4 req-b210d24b-0e28-4c47-83a8-4e9fd4a159df service nova] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Refreshing instance network info cache due to event network-changed-fb55a6bb-2879-44ea-b228-fe4609c36e10. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  815.595614] env[65478]: DEBUG oslo_concurrency.lockutils [req-44749b66-015e-4e31-afe1-60e91a07bac4 req-b210d24b-0e28-4c47-83a8-4e9fd4a159df service nova] Acquiring lock "refresh_cache-f0e88cef-300d-42a4-9cb6-843dc85da6a3" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  815.595614] env[65478]: DEBUG oslo_concurrency.lockutils [req-44749b66-015e-4e31-afe1-60e91a07bac4 req-b210d24b-0e28-4c47-83a8-4e9fd4a159df service nova] Acquired lock "refresh_cache-f0e88cef-300d-42a4-9cb6-843dc85da6a3" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  815.595614] env[65478]: DEBUG nova.network.neutron [req-44749b66-015e-4e31-afe1-60e91a07bac4 req-b210d24b-0e28-4c47-83a8-4e9fd4a159df service nova] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Refreshing network info cache for port fb55a6bb-2879-44ea-b228-fe4609c36e10 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  815.632273] env[65478]: DEBUG nova.compute.manager [req-776f5fba-eb57-4384-b006-fe5a0f325c57 req-5c33a95c-8f5f-4bec-a6b1-8933fe02d755 service nova] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Received event network-changed-0c0d9e92-abc5-4d72-881a-e5bca5e8ff47 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  815.632508] env[65478]: DEBUG nova.compute.manager [req-776f5fba-eb57-4384-b006-fe5a0f325c57 req-5c33a95c-8f5f-4bec-a6b1-8933fe02d755 service nova] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Refreshing instance network info cache due to event network-changed-0c0d9e92-abc5-4d72-881a-e5bca5e8ff47. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  815.632687] env[65478]: DEBUG oslo_concurrency.lockutils [req-776f5fba-eb57-4384-b006-fe5a0f325c57 req-5c33a95c-8f5f-4bec-a6b1-8933fe02d755 service nova] Acquiring lock "refresh_cache-6f6c4cda-9439-47dd-810c-25b0516585e6" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  815.632799] env[65478]: DEBUG oslo_concurrency.lockutils [req-776f5fba-eb57-4384-b006-fe5a0f325c57 req-5c33a95c-8f5f-4bec-a6b1-8933fe02d755 service nova] Acquired lock "refresh_cache-6f6c4cda-9439-47dd-810c-25b0516585e6" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  815.633284] env[65478]: DEBUG nova.network.neutron [req-776f5fba-eb57-4384-b006-fe5a0f325c57 req-5c33a95c-8f5f-4bec-a6b1-8933fe02d755 service nova] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Refreshing network info cache for port 0c0d9e92-abc5-4d72-881a-e5bca5e8ff47 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  815.791971] env[65478]: DEBUG nova.network.neutron [-] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  815.841229] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.507s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  815.841814] env[65478]: DEBUG nova.compute.manager [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  815.848019] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 5.924s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  815.848019] env[65478]: INFO nova.compute.claims [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  815.864246] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011739, 'name': Rename_Task} progress is 99%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  815.905851] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  816.077259] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  816.097194] env[65478]: WARNING neutronclient.v2_0.client [req-44749b66-015e-4e31-afe1-60e91a07bac4 req-b210d24b-0e28-4c47-83a8-4e9fd4a159df service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  816.138330] env[65478]: WARNING neutronclient.v2_0.client [req-776f5fba-eb57-4384-b006-fe5a0f325c57 req-5c33a95c-8f5f-4bec-a6b1-8933fe02d755 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  816.294781] env[65478]: INFO nova.compute.manager [-] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Took 2.08 seconds to deallocate network for instance.
[  816.360420] env[65478]: DEBUG nova.compute.utils [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  816.371218] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011739, 'name': Rename_Task, 'duration_secs': 1.19266} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  816.371474] env[65478]: DEBUG nova.compute.manager [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  816.371566] env[65478]: DEBUG nova.network.neutron [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  816.372081] env[65478]: WARNING neutronclient.v2_0.client [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  816.372604] env[65478]: WARNING neutronclient.v2_0.client [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  816.377703] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  816.378625] env[65478]: DEBUG oslo_vmware.service [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-7d865cc6-8981-4682-b070-c1ee4b209de4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  816.388071] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Waiting for the task: (returnval){
[  816.388071] env[65478]:    value = "task-6011740"
[  816.388071] env[65478]:    _type = "Task"
[  816.388071] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  816.402090] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011740, 'name': PowerOnVM_Task} progress is 33%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  816.801962] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  816.873856] env[65478]: DEBUG nova.compute.manager [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  816.904061] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011740, 'name': PowerOnVM_Task} progress is 66%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  816.907920] env[65478]: DEBUG nova.policy [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f2b82e779c549b3adc513eb995c6409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e75bb33e1d4885a2a67dfd4c11409a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  817.220459] env[65478]: DEBUG oslo_vmware.service [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-baa2c212-1f10-4863-a657-22f6312a41f1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  817.227662] env[65478]: DEBUG oslo_vmware.service [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c86566c5-0a24-432e-967b-6304501ad881 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  817.268035] env[65478]: DEBUG oslo_vmware.service [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4083e89c-131c-469a-bb73-83667454522c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  817.280626] env[65478]: DEBUG oslo_vmware.service [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-5eadd359-18ef-4362-a051-dabaa1c4cef6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  817.300889] env[65478]: DEBUG nova.compute.provider_tree [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  817.400138] env[65478]: DEBUG oslo_vmware.api [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011740, 'name': PowerOnVM_Task, 'duration_secs': 0.7078} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  817.400138] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  817.400138] env[65478]: INFO nova.compute.manager [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Took 10.47 seconds to spawn the instance on the hypervisor.
[  817.400138] env[65478]: DEBUG nova.compute.manager [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  817.400304] env[65478]: DEBUG oslo_vmware.service [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-672107a2-dfe2-43c5-823d-1bc9f0556bc7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  817.804886] env[65478]: DEBUG nova.scheduler.client.report [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  817.887513] env[65478]: DEBUG nova.compute.manager [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  817.929785] env[65478]: DEBUG nova.virt.hardware [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  817.934709] env[65478]: DEBUG nova.virt.hardware [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  817.934709] env[65478]: DEBUG nova.virt.hardware [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  817.934709] env[65478]: DEBUG nova.virt.hardware [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  817.934709] env[65478]: DEBUG nova.virt.hardware [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  817.934709] env[65478]: DEBUG nova.virt.hardware [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  817.939201] env[65478]: DEBUG nova.virt.hardware [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  817.939201] env[65478]: DEBUG nova.virt.hardware [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  817.939201] env[65478]: DEBUG nova.virt.hardware [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  817.939201] env[65478]: DEBUG nova.virt.hardware [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  817.939201] env[65478]: DEBUG nova.virt.hardware [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  817.944736] env[65478]: DEBUG oslo_vmware.service [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-66b81e98-91ac-47b5-bb4c-36c4da8a3e76 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  817.948814] env[65478]: INFO nova.compute.manager [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Took 16.66 seconds to build instance.
[  817.956776] env[65478]: DEBUG oslo_vmware.service [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e0146da4-3348-4e7c-8d75-41034e09b2f4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  818.308912] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.467s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  818.310735] env[65478]: DEBUG oslo_concurrency.lockutils [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 7.285s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  818.315193] env[65478]: DEBUG nova.compute.manager [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  818.315483] env[65478]: INFO nova.compute.claims [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  818.450047] env[65478]: DEBUG oslo_concurrency.lockutils [None req-79833c85-30b2-40a7-8ad9-d12e81d549ad tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Lock "6f6c4cda-9439-47dd-810c-25b0516585e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.171s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  818.487377] env[65478]: DEBUG nova.network.neutron [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Successfully created port: 2adf13cf-99c3-472f-bc02-769c66b01c29 {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  818.822135] env[65478]: DEBUG nova.compute.utils [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  818.824133] env[65478]: DEBUG nova.compute.manager [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  818.824321] env[65478]: DEBUG nova.network.neutron [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  818.825314] env[65478]: WARNING neutronclient.v2_0.client [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  818.826321] env[65478]: WARNING neutronclient.v2_0.client [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  819.028066] env[65478]: WARNING neutronclient.v2_0.client [req-44749b66-015e-4e31-afe1-60e91a07bac4 req-b210d24b-0e28-4c47-83a8-4e9fd4a159df service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  819.090375] env[65478]: WARNING neutronclient.v2_0.client [req-776f5fba-eb57-4384-b006-fe5a0f325c57 req-5c33a95c-8f5f-4bec-a6b1-8933fe02d755 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  819.142561] env[65478]: DEBUG nova.policy [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e90fae5080e0457a9557b6974756034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a09b6e5ab3418e871f2d26fcd10a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  819.328790] env[65478]: DEBUG nova.compute.manager [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  819.658969] env[65478]: DEBUG oslo_vmware.service [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-faf266c4-1c27-4907-b6dc-55efaeefcca2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  819.671025] env[65478]: DEBUG oslo_vmware.service [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-651a996a-d322-4006-a9fa-b619b614e9a9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  819.708261] env[65478]: DEBUG oslo_vmware.service [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-bfbed344-6867-4437-a389-42ce6d3648bd {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  819.718087] env[65478]: DEBUG oslo_vmware.service [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9eeb2258-4043-4ee4-8694-63322635cdfd {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  819.739729] env[65478]: DEBUG nova.compute.provider_tree [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  819.843519] env[65478]: DEBUG nova.network.neutron [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Successfully created port: 7b4081eb-c84e-4089-9d64-3d42f3c25b01 {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  820.074071] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Acquiring lock "77a0e8c4-b77a-45b9-a249-d98866d4048a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  820.074290] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Lock "77a0e8c4-b77a-45b9-a249-d98866d4048a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  820.242382] env[65478]: DEBUG nova.network.neutron [req-44749b66-015e-4e31-afe1-60e91a07bac4 req-b210d24b-0e28-4c47-83a8-4e9fd4a159df service nova] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Updated VIF entry in instance network info cache for port fb55a6bb-2879-44ea-b228-fe4609c36e10. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  820.243457] env[65478]: DEBUG nova.scheduler.client.report [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  820.247299] env[65478]: DEBUG nova.network.neutron [req-44749b66-015e-4e31-afe1-60e91a07bac4 req-b210d24b-0e28-4c47-83a8-4e9fd4a159df service nova] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Updating instance_info_cache with network_info: [{"id": "fb55a6bb-2879-44ea-b228-fe4609c36e10", "address": "fa:16:3e:20:00:e4", "network": {"id": "a0fc71cb-b2b3-4c49-84f4-a690fb3e140e", "bridge": "br-int", "label": "tempest-ServersTestJSON-389312898-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "10.180.180.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "c85e7e15986e4e379de765011083021f", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "dacd109c-2442-41b8-b612-7ed3efbdaa94", "external-id": "nsx-vlan-transportzone-940", "segmentation_id": 940, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapfb55a6bb-28", "ovs_interfaceid": "fb55a6bb-2879-44ea-b228-fe4609c36e10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  820.317939] env[65478]: DEBUG nova.network.neutron [req-776f5fba-eb57-4384-b006-fe5a0f325c57 req-5c33a95c-8f5f-4bec-a6b1-8933fe02d755 service nova] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Updated VIF entry in instance network info cache for port 0c0d9e92-abc5-4d72-881a-e5bca5e8ff47. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  820.318876] env[65478]: DEBUG nova.network.neutron [req-776f5fba-eb57-4384-b006-fe5a0f325c57 req-5c33a95c-8f5f-4bec-a6b1-8933fe02d755 service nova] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Updating instance_info_cache with network_info: [{"id": "0c0d9e92-abc5-4d72-881a-e5bca5e8ff47", "address": "fa:16:3e:08:d3:02", "network": {"id": "8419dcc5-ccb7-4667-a5ee-3f07016ddecd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "eb20b7ec77e847179c9940510a8b48bf", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "ec3f9e71-839a-429d-b211-d3dfc98ca4f6", "external-id": "nsx-vlan-transportzone-5", "segmentation_id": 5, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap0c0d9e92-ab", "ovs_interfaceid": "0c0d9e92-abc5-4d72-881a-e5bca5e8ff47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  820.339148] env[65478]: DEBUG nova.compute.manager [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  820.370111] env[65478]: DEBUG nova.virt.hardware [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  820.370353] env[65478]: DEBUG nova.virt.hardware [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  820.370474] env[65478]: DEBUG nova.virt.hardware [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  820.370760] env[65478]: DEBUG nova.virt.hardware [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  820.370815] env[65478]: DEBUG nova.virt.hardware [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  820.370915] env[65478]: DEBUG nova.virt.hardware [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  820.371099] env[65478]: DEBUG nova.virt.hardware [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  820.371217] env[65478]: DEBUG nova.virt.hardware [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  820.371342] env[65478]: DEBUG nova.virt.hardware [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  820.371525] env[65478]: DEBUG nova.virt.hardware [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  820.372302] env[65478]: DEBUG nova.virt.hardware [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  820.372581] env[65478]: DEBUG oslo_vmware.service [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f55ab038-5bbe-4334-970a-8cd500790cfd {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  820.388244] env[65478]: DEBUG oslo_vmware.service [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-95fcc496-84ea-4b9f-abca-5c751a66e74a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  820.578878] env[65478]: DEBUG nova.compute.manager [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] [instance: 77a0e8c4-b77a-45b9-a249-d98866d4048a] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  820.590809] env[65478]: DEBUG nova.network.neutron [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Successfully updated port: 2adf13cf-99c3-472f-bc02-769c66b01c29 {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  820.749746] env[65478]: DEBUG oslo_concurrency.lockutils [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.440s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  820.751271] env[65478]: DEBUG oslo_concurrency.lockutils [req-44749b66-015e-4e31-afe1-60e91a07bac4 req-b210d24b-0e28-4c47-83a8-4e9fd4a159df service nova] Releasing lock "refresh_cache-f0e88cef-300d-42a4-9cb6-843dc85da6a3" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  820.751858] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 8.170s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  820.752040] env[65478]: DEBUG nova.objects.instance [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Trying to apply a migration context that does not seem to be set for this instance {{(pid=65478) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
[  820.754205] env[65478]: DEBUG nova.compute.manager [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  820.820918] env[65478]: DEBUG oslo_concurrency.lockutils [req-776f5fba-eb57-4384-b006-fe5a0f325c57 req-5c33a95c-8f5f-4bec-a6b1-8933fe02d755 service nova] Releasing lock "refresh_cache-6f6c4cda-9439-47dd-810c-25b0516585e6" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  821.092684] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Acquiring lock "refresh_cache-fbf21f21-d370-4a6a-ae24-0e6840464e24" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  821.092834] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Acquired lock "refresh_cache-fbf21f21-d370-4a6a-ae24-0e6840464e24" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  821.092948] env[65478]: DEBUG nova.network.neutron [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  821.099493] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  821.271093] env[65478]: DEBUG nova.compute.utils [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  821.273318] env[65478]: DEBUG nova.compute.manager [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  821.273318] env[65478]: DEBUG nova.network.neutron [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  821.273318] env[65478]: WARNING neutronclient.v2_0.client [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  821.273539] env[65478]: WARNING neutronclient.v2_0.client [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  821.476149] env[65478]: DEBUG nova.policy [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5fff5b45d9fd4386a1d2d18156ca779a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f871a0b5d01940f3aac47d33c49fc4b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  821.770980] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1da5b568-a88d-4169-bbaf-0fbec380c3cb tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.021s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  821.774161] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 9.024s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  821.776470] env[65478]: INFO nova.compute.claims [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  821.782413] env[65478]: DEBUG nova.compute.manager [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  821.848349] env[65478]: DEBUG nova.network.neutron [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Successfully created port: ad31d75c-ffad-4983-9c4c-24cd6a13c154 {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  821.926444] env[65478]: DEBUG nova.network.neutron [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Successfully updated port: 7b4081eb-c84e-4089-9d64-3d42f3c25b01 {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  821.930630] env[65478]: DEBUG nova.network.neutron [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  822.093172] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Acquiring lock "4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  822.093800] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Lock "4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  822.094605] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Acquiring lock "4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  822.095370] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Lock "4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  822.095558] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Lock "4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  822.097932] env[65478]: INFO nova.compute.manager [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Terminating instance
[  822.388157] env[65478]: DEBUG nova.compute.manager [req-d754916c-824d-40c7-9b58-ad21ce91e742 req-d73407b9-440e-4a7d-a424-4171c246df19 service nova] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Received event network-vif-deleted-5c9a8578-bb94-4d72-acef-25b60278df21 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  822.411489] env[65478]: DEBUG nova.compute.manager [req-74f35d34-c9e7-461f-a7f3-a2be696d7b72 req-f82cf729-68bb-4bab-82ad-c88ed1ce45b9 service nova] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Received event network-vif-deleted-2fb52993-7218-432a-bea9-5337867a80b6 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  822.411908] env[65478]: DEBUG nova.compute.manager [req-74f35d34-c9e7-461f-a7f3-a2be696d7b72 req-f82cf729-68bb-4bab-82ad-c88ed1ce45b9 service nova] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Received event network-vif-deleted-457c1734-c99a-4d71-a200-0341a9e3bdd8 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  822.434692] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "refresh_cache-f37353fc-a5c5-41db-9d2c-c1f286fe321b" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  822.434897] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquired lock "refresh_cache-f37353fc-a5c5-41db-9d2c-c1f286fe321b" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  822.435066] env[65478]: DEBUG nova.network.neutron [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  822.602746] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Acquiring lock "refresh_cache-4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  822.603048] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Acquired lock "refresh_cache-4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  822.603151] env[65478]: DEBUG nova.network.neutron [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  822.795105] env[65478]: DEBUG nova.compute.manager [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  822.824459] env[65478]: DEBUG nova.virt.hardware [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  822.825219] env[65478]: DEBUG nova.virt.hardware [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  822.827312] env[65478]: DEBUG nova.virt.hardware [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  822.827554] env[65478]: DEBUG nova.virt.hardware [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  822.827770] env[65478]: DEBUG nova.virt.hardware [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  822.827963] env[65478]: DEBUG nova.virt.hardware [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  822.828675] env[65478]: DEBUG nova.virt.hardware [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  822.828675] env[65478]: DEBUG nova.virt.hardware [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  822.828675] env[65478]: DEBUG nova.virt.hardware [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  822.829051] env[65478]: DEBUG nova.virt.hardware [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  822.829051] env[65478]: DEBUG nova.virt.hardware [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  822.829895] env[65478]: DEBUG oslo_vmware.service [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d5241515-e9f9-4dbf-a188-c87043bf7e09 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  822.838673] env[65478]: DEBUG oslo_vmware.service [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1ce2fb74-7a20-4c6d-a450-d42dcb6e2284 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  823.052907] env[65478]: DEBUG oslo_vmware.service [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b863a169-d10b-4d0c-8c39-59623bee9627 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  823.062400] env[65478]: DEBUG oslo_vmware.service [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-528dcc49-fc7a-4c5d-aa56-6f9b3b57063e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  823.095573] env[65478]: DEBUG oslo_vmware.service [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-2dbccddd-f175-48b6-8a26-3b756618210d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  823.105905] env[65478]: DEBUG oslo_vmware.service [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-97630c1b-0ba6-422c-b596-cbcd61a1f097 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  823.109339] env[65478]: WARNING neutronclient.v2_0.client [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  823.119867] env[65478]: DEBUG nova.compute.provider_tree [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  823.547126] env[65478]: DEBUG nova.network.neutron [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Successfully updated port: ad31d75c-ffad-4983-9c4c-24cd6a13c154 {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  823.562275] env[65478]: WARNING neutronclient.v2_0.client [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  823.622946] env[65478]: DEBUG nova.scheduler.client.report [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  823.912767] env[65478]: DEBUG nova.network.neutron [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  823.926866] env[65478]: DEBUG nova.network.neutron [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  824.049563] env[65478]: DEBUG oslo_concurrency.lockutils [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Acquiring lock "refresh_cache-e9f84a20-8def-4f36-92eb-8625364f7024" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  824.049696] env[65478]: DEBUG oslo_concurrency.lockutils [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Acquired lock "refresh_cache-e9f84a20-8def-4f36-92eb-8625364f7024" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  824.049883] env[65478]: DEBUG nova.network.neutron [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  824.113369] env[65478]: DEBUG nova.network.neutron [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Updating instance_info_cache with network_info: [{"id": "2adf13cf-99c3-472f-bc02-769c66b01c29", "address": "fa:16:3e:e2:31:b9", "network": {"id": "e14ef549-022b-4519-a212-c38b5cfbac29", "bridge": "br-int", "label": "tempest-ServersV294TestFqdnHostnames-244186933-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3e75bb33e1d4885a2a67dfd4c11409a", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "f9c4edd5-d88e-4996-afea-00130ace0dad", "external-id": "nsx-vlan-transportzone-261", "segmentation_id": 261, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap2adf13cf-99", "ovs_interfaceid": "2adf13cf-99c3-472f-bc02-769c66b01c29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  824.128912] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.357s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  824.131236] env[65478]: DEBUG nova.compute.manager [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  824.133855] env[65478]: DEBUG oslo_concurrency.lockutils [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 8.958s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  824.134362] env[65478]: DEBUG nova.objects.instance [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Lazy-loading 'resources' on Instance uuid 4f7fb80a-cb05-4bd5-bb10-380d95b2e892 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  824.224517] env[65478]: DEBUG nova.network.neutron [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  824.352261] env[65478]: WARNING neutronclient.v2_0.client [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  824.605914] env[65478]: DEBUG nova.network.neutron [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Updating instance_info_cache with network_info: [{"id": "7b4081eb-c84e-4089-9d64-3d42f3c25b01", "address": "fa:16:3e:4a:ec:1b", "network": {"id": "e45f1f2f-7a0a-48b3-b75d-d13d6be57474", "bridge": "br-int", "label": "tempest-ServersAdminTestJSON-393396284-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "a8a09b6e5ab3418e871f2d26fcd10a07", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "3c92f34c-1dd7-4dc5-b8e8-f6c55cc5b4b8", "external-id": "nsx-vlan-transportzone-850", "segmentation_id": 850, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap7b4081eb-c8", "ovs_interfaceid": "7b4081eb-c84e-4089-9d64-3d42f3c25b01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  824.618962] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Releasing lock "refresh_cache-fbf21f21-d370-4a6a-ae24-0e6840464e24" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  824.621336] env[65478]: DEBUG nova.compute.manager [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Instance network_info: |[{"id": "2adf13cf-99c3-472f-bc02-769c66b01c29", "address": "fa:16:3e:e2:31:b9", "network": {"id": "e14ef549-022b-4519-a212-c38b5cfbac29", "bridge": "br-int", "label": "tempest-ServersV294TestFqdnHostnames-244186933-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3e75bb33e1d4885a2a67dfd4c11409a", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "f9c4edd5-d88e-4996-afea-00130ace0dad", "external-id": "nsx-vlan-transportzone-261", "segmentation_id": 261, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap2adf13cf-99", "ovs_interfaceid": "2adf13cf-99c3-472f-bc02-769c66b01c29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  824.621633] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:e2:31:b9', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': 'f9c4edd5-d88e-4996-afea-00130ace0dad', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': '2adf13cf-99c3-472f-bc02-769c66b01c29', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  824.634726] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Creating folder: Project (d3e75bb33e1d4885a2a67dfd4c11409a). Parent ref: group-v1161186. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  824.635237] env[65478]: DEBUG oslo_vmware.service [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-9add41c1-cd2b-4cab-ae52-43d0ca6dc11e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  824.639358] env[65478]: DEBUG nova.compute.utils [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  824.642659] env[65478]: DEBUG nova.compute.manager [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  824.643092] env[65478]: DEBUG nova.network.neutron [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  824.643199] env[65478]: WARNING neutronclient.v2_0.client [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  824.646724] env[65478]: WARNING neutronclient.v2_0.client [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  824.664051] env[65478]: DEBUG nova.network.neutron [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  824.670706] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Created folder: Project (d3e75bb33e1d4885a2a67dfd4c11409a) in parent group-v1161186.
[  824.678546] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Creating folder: Instances. Parent ref: group-v1161274. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  824.679607] env[65478]: DEBUG oslo_vmware.service [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-1b90db20-993c-43f7-b703-3cfd949cf131 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  824.696655] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Created folder: Instances in parent group-v1161274.
[  824.698407] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  824.698657] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  824.698972] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-ef50d88d-e011-4d13-8a89-551ee7dec179 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  824.728491] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Releasing lock "refresh_cache-4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  824.728491] env[65478]: DEBUG nova.compute.manager [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[  824.728491] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  824.729934] env[65478]: DEBUG oslo_vmware.service [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-19e8c2b7-bca5-4814-b74a-b25f99a7bf34 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  824.734569] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  824.734569] env[65478]:    value = "task-6011747"
[  824.734569] env[65478]:    _type = "Task"
[  824.734569] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  824.753820] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  824.754158] env[65478]: DEBUG oslo_vmware.service [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-291dec44-1852-4339-af26-29887d4cf386 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  824.759626] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011747, 'name': CreateVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  824.766786] env[65478]: DEBUG oslo_vmware.api [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Waiting for the task: (returnval){
[  824.766786] env[65478]:    value = "task-6011748"
[  824.766786] env[65478]:    _type = "Task"
[  824.766786] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  824.775393] env[65478]: DEBUG nova.policy [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '347fb9df152540528410e3ff102010c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de0dd2b26b24b4fb6e13f475974035a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  824.785938] env[65478]: DEBUG oslo_vmware.api [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011748, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  825.112812] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Releasing lock "refresh_cache-f37353fc-a5c5-41db-9d2c-c1f286fe321b" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  825.112812] env[65478]: DEBUG nova.compute.manager [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Instance network_info: |[{"id": "7b4081eb-c84e-4089-9d64-3d42f3c25b01", "address": "fa:16:3e:4a:ec:1b", "network": {"id": "e45f1f2f-7a0a-48b3-b75d-d13d6be57474", "bridge": "br-int", "label": "tempest-ServersAdminTestJSON-393396284-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "a8a09b6e5ab3418e871f2d26fcd10a07", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "3c92f34c-1dd7-4dc5-b8e8-f6c55cc5b4b8", "external-id": "nsx-vlan-transportzone-850", "segmentation_id": 850, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap7b4081eb-c8", "ovs_interfaceid": "7b4081eb-c84e-4089-9d64-3d42f3c25b01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  825.113243] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:4a:ec:1b', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': '3c92f34c-1dd7-4dc5-b8e8-f6c55cc5b4b8', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': '7b4081eb-c84e-4089-9d64-3d42f3c25b01', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  825.127669] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  825.128710] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  825.128710] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-318cae5f-f130-4e7a-a208-532dbd751ebf {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  825.151769] env[65478]: DEBUG nova.compute.manager [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  825.176473] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  825.176473] env[65478]:    value = "task-6011752"
[  825.176473] env[65478]:    _type = "Task"
[  825.176473] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  825.188568] env[65478]: DEBUG oslo_vmware.service [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-33b46aa9-bf13-49ad-a673-6994a3d9087f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  825.196537] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011752, 'name': CreateVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  825.206155] env[65478]: DEBUG oslo_vmware.service [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-800e0830-e747-4561-9828-5af0bd3abc2f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  825.257824] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011747, 'name': CreateVM_Task} progress is 99%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  825.270238] env[65478]: DEBUG oslo_vmware.service [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ce0a155f-8bca-4ef1-8357-2c94d4b6e356 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  825.289439] env[65478]: DEBUG oslo_vmware.api [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011748, 'name': PowerOffVM_Task, 'duration_secs': 0.197798} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  825.294644] env[65478]: DEBUG oslo_vmware.service [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8a5c4779-93ed-4a61-884a-c10e66f5a06c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  825.300775] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  825.303080] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  825.305895] env[65478]: DEBUG oslo_vmware.service [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-52f61a35-ac78-4243-8b8d-d5ee7fecb99e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  825.312770] env[65478]: WARNING neutronclient.v2_0.client [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  825.328195] env[65478]: DEBUG nova.network.neutron [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Successfully created port: f0b49860-9c56-46f5-9519-2051bdc60f75 {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  825.338068] env[65478]: DEBUG nova.compute.provider_tree [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  825.358391] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  825.358570] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Deleting contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  825.358835] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Deleting the datastore file [datastore1] 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3 {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  825.360225] env[65478]: DEBUG oslo_vmware.service [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-b5bcdb90-d66a-4bdd-a030-c4ddaca6137a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  825.375570] env[65478]: DEBUG oslo_vmware.api [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Waiting for the task: (returnval){
[  825.375570] env[65478]:    value = "task-6011754"
[  825.375570] env[65478]:    _type = "Task"
[  825.375570] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  825.392069] env[65478]: DEBUG oslo_vmware.api [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011754, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  825.455131] env[65478]: DEBUG oslo_concurrency.lockutils [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Acquiring lock "d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  825.455595] env[65478]: DEBUG oslo_concurrency.lockutils [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Lock "d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  825.470989] env[65478]: DEBUG oslo_concurrency.lockutils [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Acquiring lock "30e11bc9-0bfa-4cbf-bd02-f8262e343b79" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  825.472110] env[65478]: DEBUG oslo_concurrency.lockutils [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Lock "30e11bc9-0bfa-4cbf-bd02-f8262e343b79" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  825.532586] env[65478]: DEBUG nova.network.neutron [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Updating instance_info_cache with network_info: [{"id": "ad31d75c-ffad-4983-9c4c-24cd6a13c154", "address": "fa:16:3e:b0:a6:58", "network": {"id": "6cee7b68-cb51-4c00-b143-8061d7844510", "bridge": "br-int", "label": "tempest-ImagesOneServerTestJSON-1681313208-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f871a0b5d01940f3aac47d33c49fc4b3", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "29945b49-d2b8-449d-9531-437917f49839", "external-id": "nsx-vlan-transportzone-787", "segmentation_id": 787, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapad31d75c-ff", "ovs_interfaceid": "ad31d75c-ffad-4983-9c4c-24cd6a13c154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  825.688088] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011752, 'name': CreateVM_Task, 'duration_secs': 0.439592} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  825.688420] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  825.688833] env[65478]: WARNING neutronclient.v2_0.client [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  825.689247] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  825.689316] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquired lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  825.689571] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquired external semaphore "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  825.690485] env[65478]: DEBUG oslo_vmware.service [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-882e9ed9-b628-4baa-9ed9-71f89729de19 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  825.695509] env[65478]: DEBUG oslo_vmware.api [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[  825.695509] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]525e77db-52fa-beff-3adb-2d1d22019fab"
[  825.695509] env[65478]:    _type = "Task"
[  825.695509] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  825.705945] env[65478]: DEBUG oslo_vmware.api [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]525e77db-52fa-beff-3adb-2d1d22019fab, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  825.757296] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011747, 'name': CreateVM_Task, 'duration_secs': 0.564541} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  825.757548] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  825.758871] env[65478]: WARNING neutronclient.v2_0.client [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  825.759195] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  825.759318] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  825.759677] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Acquired external semaphore "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  825.760093] env[65478]: DEBUG oslo_vmware.service [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-8c030c97-5615-4f1f-a726-2e9258097734 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  825.767247] env[65478]: DEBUG oslo_vmware.api [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Waiting for the task: (returnval){
[  825.767247] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]522d6caa-c2d2-f962-4994-8f2aac9090be"
[  825.767247] env[65478]:    _type = "Task"
[  825.767247] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  825.782341] env[65478]: DEBUG oslo_vmware.api [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]522d6caa-c2d2-f962-4994-8f2aac9090be, 'name': SearchDatastore_Task, 'duration_secs': 0.011197} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  825.782622] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  825.782818] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  825.783218] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  825.783218] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  825.783346] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Creating directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  825.783927] env[65478]: DEBUG oslo_vmware.service [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-aeef302d-0f90-4c29-bc87-fb47c83d24b9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  825.793498] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Created directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  825.793806] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Folder [datastore1] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  825.794527] env[65478]: DEBUG oslo_vmware.service [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-ec06a8d1-6165-4178-94be-f877a3e51353 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  825.802213] env[65478]: DEBUG oslo_vmware.api [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Waiting for the task: (returnval){
[  825.802213] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52bd6919-abb3-9b5c-9af3-547480686f46"
[  825.802213] env[65478]:    _type = "Task"
[  825.802213] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  825.814708] env[65478]: DEBUG oslo_vmware.api [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52bd6919-abb3-9b5c-9af3-547480686f46, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  825.845058] env[65478]: DEBUG nova.scheduler.client.report [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  825.887886] env[65478]: DEBUG oslo_vmware.api [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Task: {'id': task-6011754, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.122561} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  825.888086] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  825.888225] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Deleted contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  825.888354] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  825.888488] env[65478]: INFO nova.compute.manager [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Took 1.16 seconds to destroy the instance on the hypervisor.
[  825.889106] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  825.889367] env[65478]: DEBUG nova.compute.manager [-] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[  825.889490] env[65478]: DEBUG nova.network.neutron [-] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[  825.889752] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  825.960489] env[65478]: DEBUG nova.compute.manager [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] [instance: d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  825.976638] env[65478]: DEBUG nova.compute.manager [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 30e11bc9-0bfa-4cbf-bd02-f8262e343b79] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  825.990288] env[65478]: DEBUG nova.network.neutron [-] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  825.990517] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  826.035556] env[65478]: DEBUG oslo_concurrency.lockutils [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Releasing lock "refresh_cache-e9f84a20-8def-4f36-92eb-8625364f7024" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  826.035867] env[65478]: DEBUG nova.compute.manager [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Instance network_info: |[{"id": "ad31d75c-ffad-4983-9c4c-24cd6a13c154", "address": "fa:16:3e:b0:a6:58", "network": {"id": "6cee7b68-cb51-4c00-b143-8061d7844510", "bridge": "br-int", "label": "tempest-ImagesOneServerTestJSON-1681313208-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f871a0b5d01940f3aac47d33c49fc4b3", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "29945b49-d2b8-449d-9531-437917f49839", "external-id": "nsx-vlan-transportzone-787", "segmentation_id": 787, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapad31d75c-ff", "ovs_interfaceid": "ad31d75c-ffad-4983-9c4c-24cd6a13c154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  826.036098] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] Acquiring lock "00b6d30d-5de3-4c87-8af4-0fe6d88eb906" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  826.036484] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] Lock "00b6d30d-5de3-4c87-8af4-0fe6d88eb906" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  826.037535] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:b0:a6:58', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': '29945b49-d2b8-449d-9531-437917f49839', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': 'ad31d75c-ffad-4983-9c4c-24cd6a13c154', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  826.054114] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Creating folder: Project (f871a0b5d01940f3aac47d33c49fc4b3). Parent ref: group-v1161186. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  826.056657] env[65478]: DEBUG oslo_vmware.service [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-0323a010-3eee-4cb1-a428-08feab21e57a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  826.068299] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Created folder: Project (f871a0b5d01940f3aac47d33c49fc4b3) in parent group-v1161186.
[  826.068448] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Creating folder: Instances. Parent ref: group-v1161281. {{(pid=65478) create_folder /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1599}}
[  826.068693] env[65478]: DEBUG oslo_vmware.service [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking Folder.CreateFolder with opID=oslo.vmware-183f7d7b-4e3b-4a7a-9197-75a67e8d798b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  826.080904] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Created folder: Instances in parent group-v1161281.
[  826.081589] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  826.081931] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  826.082238] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-ef290ef6-fadc-4847-8379-356dc2b4945e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  826.107996] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  826.107996] env[65478]:    value = "task-6011758"
[  826.107996] env[65478]:    _type = "Task"
[  826.107996] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  826.118492] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011758, 'name': CreateVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  826.175492] env[65478]: DEBUG nova.compute.manager [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  826.207996] env[65478]: DEBUG oslo_vmware.api [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]525e77db-52fa-beff-3adb-2d1d22019fab, 'name': SearchDatastore_Task, 'duration_secs': 0.011022} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  826.208250] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Releasing lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  826.208439] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  826.208643] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  826.208757] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquired lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  826.208894] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Creating directory with path [datastore2] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  826.209193] env[65478]: DEBUG oslo_vmware.service [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-1f84452d-8f8d-4d5d-8d81-fc044425be6f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  826.218753] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Created directory with path [datastore2] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  826.218996] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Folder [datastore2] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  826.220412] env[65478]: DEBUG oslo_vmware.service [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-1e03c111-475c-4ad5-b5ac-87d5dd8d7063 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  826.231726] env[65478]: DEBUG oslo_vmware.api [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[  826.231726] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52e931c3-ab54-a0bf-fcae-72dcc117b264"
[  826.231726] env[65478]:    _type = "Task"
[  826.231726] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  826.234483] env[65478]: DEBUG nova.virt.hardware [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  826.234712] env[65478]: DEBUG nova.virt.hardware [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  826.234841] env[65478]: DEBUG nova.virt.hardware [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  826.234995] env[65478]: DEBUG nova.virt.hardware [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  826.235114] env[65478]: DEBUG nova.virt.hardware [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  826.235233] env[65478]: DEBUG nova.virt.hardware [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  826.235414] env[65478]: DEBUG nova.virt.hardware [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  826.235544] env[65478]: DEBUG nova.virt.hardware [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  826.235690] env[65478]: DEBUG nova.virt.hardware [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  826.235819] env[65478]: DEBUG nova.virt.hardware [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  826.235949] env[65478]: DEBUG nova.virt.hardware [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  826.237166] env[65478]: DEBUG oslo_vmware.service [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6794178b-fd03-4e3c-893d-f90935fa7a09 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  826.244049] env[65478]: DEBUG oslo_vmware.api [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52e931c3-ab54-a0bf-fcae-72dcc117b264, 'name': SearchDatastore_Task, 'duration_secs': 0.010263} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  826.244867] env[65478]: DEBUG oslo_vmware.service [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-ee7c6f4a-f59d-4c50-a7c7-5e106d98af9c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  826.251533] env[65478]: DEBUG oslo_vmware.service [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-82717d11-325a-47b8-bf75-83dcd64a463c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  826.257284] env[65478]: DEBUG oslo_vmware.api [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[  826.257284] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52dbad56-bca3-02c6-6bd4-bdf306ccb857"
[  826.257284] env[65478]:    _type = "Task"
[  826.257284] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  826.267230] env[65478]: DEBUG oslo_vmware.api [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52dbad56-bca3-02c6-6bd4-bdf306ccb857, 'name': SearchDatastore_Task, 'duration_secs': 0.00962} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  826.272724] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Releasing lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  826.275923] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Copying Virtual Disk [datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore2] f37353fc-a5c5-41db-9d2c-c1f286fe321b/f37353fc-a5c5-41db-9d2c-c1f286fe321b.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  826.276274] env[65478]: DEBUG oslo_vmware.service [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-4d43f8ed-04ed-4015-a3ab-e248b43543a3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  826.284601] env[65478]: DEBUG oslo_vmware.api [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[  826.284601] env[65478]:    value = "task-6011759"
[  826.284601] env[65478]:    _type = "Task"
[  826.284601] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  826.297436] env[65478]: DEBUG oslo_vmware.api [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011759, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  826.318587] env[65478]: DEBUG oslo_vmware.api [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52bd6919-abb3-9b5c-9af3-547480686f46, 'name': SearchDatastore_Task, 'duration_secs': 0.01098} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  826.320040] env[65478]: DEBUG oslo_vmware.service [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-404df582-1af3-4e5e-8df9-dad51e5019db {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  826.327310] env[65478]: DEBUG oslo_vmware.api [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Waiting for the task: (returnval){
[  826.327310] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52bb3228-6d0c-02aa-d3c9-a57f1a5d66c7"
[  826.327310] env[65478]:    _type = "Task"
[  826.327310] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  826.338900] env[65478]: DEBUG oslo_vmware.api [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52bb3228-6d0c-02aa-d3c9-a57f1a5d66c7, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  826.351093] env[65478]: DEBUG oslo_concurrency.lockutils [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.217s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  826.354491] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 10.446s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  826.357206] env[65478]: INFO nova.compute.claims [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  826.395861] env[65478]: INFO nova.scheduler.client.report [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Deleted allocations for instance 4f7fb80a-cb05-4bd5-bb10-380d95b2e892
[  826.490795] env[65478]: DEBUG oslo_concurrency.lockutils [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  826.494469] env[65478]: DEBUG nova.network.neutron [-] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  826.509567] env[65478]: DEBUG oslo_concurrency.lockutils [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  826.551535] env[65478]: DEBUG nova.compute.manager [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] [instance: 00b6d30d-5de3-4c87-8af4-0fe6d88eb906] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  826.620324] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011758, 'name': CreateVM_Task, 'duration_secs': 0.44562} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  826.620970] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  826.621725] env[65478]: WARNING neutronclient.v2_0.client [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  826.622016] env[65478]: DEBUG oslo_concurrency.lockutils [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  826.622149] env[65478]: DEBUG oslo_concurrency.lockutils [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  826.622478] env[65478]: DEBUG oslo_concurrency.lockutils [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Acquired external semaphore "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  826.623095] env[65478]: DEBUG oslo_vmware.service [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-7785457e-5ba9-4e02-bad6-ae73250aa647 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  826.629919] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Waiting for the task: (returnval){
[  826.629919] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52269459-9156-fb29-2584-e8b6c6562e32"
[  826.629919] env[65478]:    _type = "Task"
[  826.629919] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  826.643256] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52269459-9156-fb29-2584-e8b6c6562e32, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  826.645620] env[65478]: DEBUG nova.compute.manager [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Received event network-vif-plugged-2adf13cf-99c3-472f-bc02-769c66b01c29 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  826.646401] env[65478]: DEBUG oslo_concurrency.lockutils [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] Acquiring lock "fbf21f21-d370-4a6a-ae24-0e6840464e24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  826.646739] env[65478]: DEBUG oslo_concurrency.lockutils [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] Lock "fbf21f21-d370-4a6a-ae24-0e6840464e24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  826.646911] env[65478]: DEBUG oslo_concurrency.lockutils [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] Lock "fbf21f21-d370-4a6a-ae24-0e6840464e24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  826.647097] env[65478]: DEBUG nova.compute.manager [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] No waiting events found dispatching network-vif-plugged-2adf13cf-99c3-472f-bc02-769c66b01c29 {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  826.647356] env[65478]: WARNING nova.compute.manager [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Received unexpected event network-vif-plugged-2adf13cf-99c3-472f-bc02-769c66b01c29 for instance with vm_state building and task_state spawning.
[  826.647632] env[65478]: DEBUG nova.compute.manager [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Received event network-changed-2adf13cf-99c3-472f-bc02-769c66b01c29 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  826.647843] env[65478]: DEBUG nova.compute.manager [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Refreshing instance network info cache due to event network-changed-2adf13cf-99c3-472f-bc02-769c66b01c29. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  826.649272] env[65478]: DEBUG oslo_concurrency.lockutils [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] Acquiring lock "refresh_cache-fbf21f21-d370-4a6a-ae24-0e6840464e24" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  826.649387] env[65478]: DEBUG oslo_concurrency.lockutils [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] Acquired lock "refresh_cache-fbf21f21-d370-4a6a-ae24-0e6840464e24" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  826.649519] env[65478]: DEBUG nova.network.neutron [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Refreshing network info cache for port 2adf13cf-99c3-472f-bc02-769c66b01c29 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  826.668044] env[65478]: DEBUG nova.compute.manager [req-affc89cd-406f-48da-8f77-39bae5d7824b req-c0964430-dcb0-498e-bf68-8ac688ee41b0 service nova] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Received event network-vif-plugged-7b4081eb-c84e-4089-9d64-3d42f3c25b01 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  826.668860] env[65478]: DEBUG oslo_concurrency.lockutils [req-affc89cd-406f-48da-8f77-39bae5d7824b req-c0964430-dcb0-498e-bf68-8ac688ee41b0 service nova] Acquiring lock "f37353fc-a5c5-41db-9d2c-c1f286fe321b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  826.670220] env[65478]: DEBUG oslo_concurrency.lockutils [req-affc89cd-406f-48da-8f77-39bae5d7824b req-c0964430-dcb0-498e-bf68-8ac688ee41b0 service nova] Lock "f37353fc-a5c5-41db-9d2c-c1f286fe321b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  826.670379] env[65478]: DEBUG oslo_concurrency.lockutils [req-affc89cd-406f-48da-8f77-39bae5d7824b req-c0964430-dcb0-498e-bf68-8ac688ee41b0 service nova] Lock "f37353fc-a5c5-41db-9d2c-c1f286fe321b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  826.670575] env[65478]: DEBUG nova.compute.manager [req-affc89cd-406f-48da-8f77-39bae5d7824b req-c0964430-dcb0-498e-bf68-8ac688ee41b0 service nova] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] No waiting events found dispatching network-vif-plugged-7b4081eb-c84e-4089-9d64-3d42f3c25b01 {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  826.670701] env[65478]: WARNING nova.compute.manager [req-affc89cd-406f-48da-8f77-39bae5d7824b req-c0964430-dcb0-498e-bf68-8ac688ee41b0 service nova] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Received unexpected event network-vif-plugged-7b4081eb-c84e-4089-9d64-3d42f3c25b01 for instance with vm_state building and task_state spawning.
[  826.671795] env[65478]: DEBUG nova.compute.manager [req-affc89cd-406f-48da-8f77-39bae5d7824b req-c0964430-dcb0-498e-bf68-8ac688ee41b0 service nova] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Received event network-changed-7b4081eb-c84e-4089-9d64-3d42f3c25b01 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  826.671795] env[65478]: DEBUG nova.compute.manager [req-affc89cd-406f-48da-8f77-39bae5d7824b req-c0964430-dcb0-498e-bf68-8ac688ee41b0 service nova] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Refreshing instance network info cache due to event network-changed-7b4081eb-c84e-4089-9d64-3d42f3c25b01. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  826.672062] env[65478]: DEBUG oslo_concurrency.lockutils [req-affc89cd-406f-48da-8f77-39bae5d7824b req-c0964430-dcb0-498e-bf68-8ac688ee41b0 service nova] Acquiring lock "refresh_cache-f37353fc-a5c5-41db-9d2c-c1f286fe321b" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  826.672202] env[65478]: DEBUG oslo_concurrency.lockutils [req-affc89cd-406f-48da-8f77-39bae5d7824b req-c0964430-dcb0-498e-bf68-8ac688ee41b0 service nova] Acquired lock "refresh_cache-f37353fc-a5c5-41db-9d2c-c1f286fe321b" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  826.672730] env[65478]: DEBUG nova.network.neutron [req-affc89cd-406f-48da-8f77-39bae5d7824b req-c0964430-dcb0-498e-bf68-8ac688ee41b0 service nova] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Refreshing network info cache for port 7b4081eb-c84e-4089-9d64-3d42f3c25b01 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  826.796560] env[65478]: DEBUG oslo_vmware.api [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011759, 'name': CopyVirtualDisk_Task} progress is 77%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  826.844222] env[65478]: DEBUG oslo_vmware.api [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52bb3228-6d0c-02aa-d3c9-a57f1a5d66c7, 'name': SearchDatastore_Task, 'duration_secs': 0.011441} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  826.848248] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  826.848248] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Copying Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] fbf21f21-d370-4a6a-ae24-0e6840464e24/fbf21f21-d370-4a6a-ae24-0e6840464e24.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  826.848248] env[65478]: DEBUG oslo_vmware.service [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-5de77513-c13d-4856-ab03-f9c3bed4c59d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  826.855536] env[65478]: DEBUG oslo_vmware.api [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Waiting for the task: (returnval){
[  826.855536] env[65478]:    value = "task-6011760"
[  826.855536] env[65478]:    _type = "Task"
[  826.855536] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  826.865053] env[65478]: DEBUG oslo_vmware.api [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Task: {'id': task-6011760, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  826.910675] env[65478]: DEBUG oslo_concurrency.lockutils [None req-bc14c48c-2cc8-4cab-935c-3192ac9fbb36 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Lock "4f7fb80a-cb05-4bd5-bb10-380d95b2e892" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 16.119s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  826.999674] env[65478]: INFO nova.compute.manager [-] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Took 1.11 seconds to deallocate network for instance.
[  827.088694] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  827.145981] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52269459-9156-fb29-2584-e8b6c6562e32, 'name': SearchDatastore_Task, 'duration_secs': 0.021913} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  827.145981] env[65478]: DEBUG oslo_concurrency.lockutils [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  827.146186] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  827.147043] env[65478]: DEBUG oslo_concurrency.lockutils [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  827.147043] env[65478]: DEBUG oslo_concurrency.lockutils [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  827.147043] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Creating directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  827.149274] env[65478]: DEBUG oslo_vmware.service [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-6caa62dd-7142-447a-9411-714c71c54e3d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  827.153518] env[65478]: DEBUG nova.network.neutron [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Successfully updated port: f0b49860-9c56-46f5-9519-2051bdc60f75 {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  827.156176] env[65478]: WARNING neutronclient.v2_0.client [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  827.165604] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Created directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  827.165843] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Folder [datastore1] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  827.166869] env[65478]: DEBUG oslo_vmware.service [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-c28f3d8b-c206-4c70-938b-93feb2d48d51 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  827.178013] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Waiting for the task: (returnval){
[  827.178013] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]529323e0-6ee1-ce7d-afec-66ef026e4fb6"
[  827.178013] env[65478]:    _type = "Task"
[  827.178013] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  827.189150] env[65478]: WARNING neutronclient.v2_0.client [req-affc89cd-406f-48da-8f77-39bae5d7824b req-c0964430-dcb0-498e-bf68-8ac688ee41b0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  827.207622] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]529323e0-6ee1-ce7d-afec-66ef026e4fb6, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  827.303543] env[65478]: DEBUG oslo_vmware.api [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011759, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.567653} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  827.304235] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Copied Virtual Disk [datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore2] f37353fc-a5c5-41db-9d2c-c1f286fe321b/f37353fc-a5c5-41db-9d2c-c1f286fe321b.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  827.304414] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  827.304675] env[65478]: DEBUG oslo_vmware.service [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-4be67cee-7e54-4783-b3d7-1015fde7b857 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  827.314345] env[65478]: DEBUG oslo_vmware.api [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[  827.314345] env[65478]:    value = "task-6011761"
[  827.314345] env[65478]:    _type = "Task"
[  827.314345] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  827.325035] env[65478]: DEBUG oslo_vmware.api [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011761, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  827.373132] env[65478]: DEBUG oslo_vmware.api [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Task: {'id': task-6011760, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.490559} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  827.373384] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Copied Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] fbf21f21-d370-4a6a-ae24-0e6840464e24/fbf21f21-d370-4a6a-ae24-0e6840464e24.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  827.376037] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  827.381975] env[65478]: DEBUG oslo_vmware.service [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-ea5a0020-5035-4fce-a3bb-6d6d8f933ccd {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  827.393781] env[65478]: DEBUG oslo_vmware.api [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Waiting for the task: (returnval){
[  827.393781] env[65478]:    value = "task-6011762"
[  827.393781] env[65478]:    _type = "Task"
[  827.393781] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  827.406478] env[65478]: DEBUG oslo_vmware.api [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Task: {'id': task-6011762, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  827.506328] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  827.524850] env[65478]: WARNING neutronclient.v2_0.client [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  827.539123] env[65478]: WARNING neutronclient.v2_0.client [req-affc89cd-406f-48da-8f77-39bae5d7824b req-c0964430-dcb0-498e-bf68-8ac688ee41b0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  827.656884] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Acquiring lock "refresh_cache-28200981-9217-4395-b0a8-c154624c7a1c" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  827.657098] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Acquired lock "refresh_cache-28200981-9217-4395-b0a8-c154624c7a1c" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  827.657431] env[65478]: DEBUG nova.network.neutron [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  827.696219] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]529323e0-6ee1-ce7d-afec-66ef026e4fb6, 'name': SearchDatastore_Task, 'duration_secs': 0.054492} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  827.697223] env[65478]: DEBUG oslo_vmware.service [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-3294e4b6-899a-46ee-bda0-0f8f97064a06 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  827.703016] env[65478]: DEBUG nova.network.neutron [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Updated VIF entry in instance network info cache for port 2adf13cf-99c3-472f-bc02-769c66b01c29. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  827.703929] env[65478]: DEBUG nova.network.neutron [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Updating instance_info_cache with network_info: [{"id": "2adf13cf-99c3-472f-bc02-769c66b01c29", "address": "fa:16:3e:e2:31:b9", "network": {"id": "e14ef549-022b-4519-a212-c38b5cfbac29", "bridge": "br-int", "label": "tempest-ServersV294TestFqdnHostnames-244186933-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3e75bb33e1d4885a2a67dfd4c11409a", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "f9c4edd5-d88e-4996-afea-00130ace0dad", "external-id": "nsx-vlan-transportzone-261", "segmentation_id": 261, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap2adf13cf-99", "ovs_interfaceid": "2adf13cf-99c3-472f-bc02-769c66b01c29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  827.707641] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Waiting for the task: (returnval){
[  827.707641] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]5254e416-b26f-320f-70fe-7719be6ec5a1"
[  827.707641] env[65478]:    _type = "Task"
[  827.707641] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  827.718698] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5254e416-b26f-320f-70fe-7719be6ec5a1, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  827.780930] env[65478]: DEBUG nova.network.neutron [req-affc89cd-406f-48da-8f77-39bae5d7824b req-c0964430-dcb0-498e-bf68-8ac688ee41b0 service nova] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Updated VIF entry in instance network info cache for port 7b4081eb-c84e-4089-9d64-3d42f3c25b01. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  827.781270] env[65478]: DEBUG nova.network.neutron [req-affc89cd-406f-48da-8f77-39bae5d7824b req-c0964430-dcb0-498e-bf68-8ac688ee41b0 service nova] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Updating instance_info_cache with network_info: [{"id": "7b4081eb-c84e-4089-9d64-3d42f3c25b01", "address": "fa:16:3e:4a:ec:1b", "network": {"id": "e45f1f2f-7a0a-48b3-b75d-d13d6be57474", "bridge": "br-int", "label": "tempest-ServersAdminTestJSON-393396284-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "a8a09b6e5ab3418e871f2d26fcd10a07", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "3c92f34c-1dd7-4dc5-b8e8-f6c55cc5b4b8", "external-id": "nsx-vlan-transportzone-850", "segmentation_id": 850, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap7b4081eb-c8", "ovs_interfaceid": "7b4081eb-c84e-4089-9d64-3d42f3c25b01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  827.842205] env[65478]: DEBUG oslo_vmware.api [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011761, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.078924} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  827.842205] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  827.842205] env[65478]: DEBUG oslo_vmware.service [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9b5d8310-f6f3-4e54-8b67-3743aa03d916 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  827.869054] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Reconfiguring VM instance instance-0000001e to attach disk [datastore2] f37353fc-a5c5-41db-9d2c-c1f286fe321b/f37353fc-a5c5-41db-9d2c-c1f286fe321b.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  827.869379] env[65478]: DEBUG oslo_vmware.service [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-5c0a740d-d24e-4d4a-94d7-0b18f494f277 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  827.906452] env[65478]: DEBUG oslo_vmware.api [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[  827.906452] env[65478]:    value = "task-6011764"
[  827.906452] env[65478]:    _type = "Task"
[  827.906452] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  827.911764] env[65478]: DEBUG oslo_vmware.api [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Task: {'id': task-6011762, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.065688} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  827.912164] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  827.913722] env[65478]: DEBUG oslo_vmware.service [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0c85f382-7ebd-42ff-a610-9efa0627f985 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  827.933118] env[65478]: DEBUG oslo_vmware.api [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011764, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  827.959058] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Reconfiguring VM instance instance-0000001d to attach disk [datastore1] fbf21f21-d370-4a6a-ae24-0e6840464e24/fbf21f21-d370-4a6a-ae24-0e6840464e24.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  827.959595] env[65478]: DEBUG oslo_vmware.service [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-3869933d-1cea-432b-87df-de94873257cb {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  827.982341] env[65478]: WARNING nova.utils [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8fc72e7a0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  827.982341] env[65478]: DEBUG oslo_vmware.service [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8383b250-8764-4180-a907-6e7b23adfd3e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  828.000528] env[65478]: DEBUG oslo_vmware.service [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f33293fa-bbb8-487b-85b2-e92d58c1cba9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  828.017383] env[65478]: DEBUG oslo_vmware.api [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Waiting for the task: (returnval){
[  828.017383] env[65478]:    value = "task-6011765"
[  828.017383] env[65478]:    _type = "Task"
[  828.017383] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  828.037039] env[65478]: DEBUG oslo_vmware.api [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Task: {'id': task-6011765, 'name': ReconfigVM_Task} progress is 10%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  828.071429] env[65478]: DEBUG oslo_vmware.service [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-7e382fcd-34bf-4349-82df-ddcbf319cc47 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  828.082167] env[65478]: DEBUG nova.compute.manager [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Stashing vm_state: active {{(pid=65478) _prep_resize /opt/stack/nova/nova/compute/manager.py:6217}}
[  828.090964] env[65478]: DEBUG oslo_vmware.service [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a4112f1a-ddb1-4638-ba7a-d5cdbf88a4bf {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  828.122829] env[65478]: DEBUG nova.compute.provider_tree [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  828.208819] env[65478]: DEBUG oslo_concurrency.lockutils [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] Releasing lock "refresh_cache-fbf21f21-d370-4a6a-ae24-0e6840464e24" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  828.209077] env[65478]: DEBUG nova.compute.manager [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Received event network-vif-plugged-ad31d75c-ffad-4983-9c4c-24cd6a13c154 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  828.210038] env[65478]: DEBUG oslo_concurrency.lockutils [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] Acquiring lock "e9f84a20-8def-4f36-92eb-8625364f7024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  828.217034] env[65478]: DEBUG oslo_concurrency.lockutils [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] Lock "e9f84a20-8def-4f36-92eb-8625364f7024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  828.217246] env[65478]: DEBUG oslo_concurrency.lockutils [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] Lock "e9f84a20-8def-4f36-92eb-8625364f7024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  828.219364] env[65478]: DEBUG nova.compute.manager [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] No waiting events found dispatching network-vif-plugged-ad31d75c-ffad-4983-9c4c-24cd6a13c154 {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  828.219664] env[65478]: WARNING nova.compute.manager [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Received unexpected event network-vif-plugged-ad31d75c-ffad-4983-9c4c-24cd6a13c154 for instance with vm_state building and task_state spawning.
[  828.219908] env[65478]: DEBUG nova.compute.manager [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Received event network-changed-ad31d75c-ffad-4983-9c4c-24cd6a13c154 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  828.219967] env[65478]: DEBUG nova.compute.manager [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Refreshing instance network info cache due to event network-changed-ad31d75c-ffad-4983-9c4c-24cd6a13c154. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  828.220287] env[65478]: DEBUG oslo_concurrency.lockutils [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] Acquiring lock "refresh_cache-e9f84a20-8def-4f36-92eb-8625364f7024" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  828.220392] env[65478]: DEBUG oslo_concurrency.lockutils [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] Acquired lock "refresh_cache-e9f84a20-8def-4f36-92eb-8625364f7024" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  828.220546] env[65478]: DEBUG nova.network.neutron [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Refreshing network info cache for port ad31d75c-ffad-4983-9c4c-24cd6a13c154 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  828.231308] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5254e416-b26f-320f-70fe-7719be6ec5a1, 'name': SearchDatastore_Task, 'duration_secs': 0.02343} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  828.231308] env[65478]: DEBUG oslo_concurrency.lockutils [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  828.231308] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Copying Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] e9f84a20-8def-4f36-92eb-8625364f7024/e9f84a20-8def-4f36-92eb-8625364f7024.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  828.231308] env[65478]: DEBUG oslo_vmware.service [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-c89a794f-334d-4dbd-9676-c2a58f07ed88 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  828.240604] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Waiting for the task: (returnval){
[  828.240604] env[65478]:    value = "task-6011766"
[  828.240604] env[65478]:    _type = "Task"
[  828.240604] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  828.253350] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011766, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  828.255897] env[65478]: DEBUG nova.network.neutron [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  828.284829] env[65478]: DEBUG oslo_concurrency.lockutils [req-affc89cd-406f-48da-8f77-39bae5d7824b req-c0964430-dcb0-498e-bf68-8ac688ee41b0 service nova] Releasing lock "refresh_cache-f37353fc-a5c5-41db-9d2c-c1f286fe321b" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  828.418214] env[65478]: DEBUG oslo_vmware.api [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011764, 'name': ReconfigVM_Task, 'duration_secs': 0.431337} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  828.419968] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Reconfigured VM instance instance-0000001e to attach disk [datastore2] f37353fc-a5c5-41db-9d2c-c1f286fe321b/f37353fc-a5c5-41db-9d2c-c1f286fe321b.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  828.420867] env[65478]: DEBUG oslo_vmware.service [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-d13e075b-c623-4b4c-9077-da6f5b2ea8e1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  828.430575] env[65478]: DEBUG oslo_vmware.api [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[  828.430575] env[65478]:    value = "task-6011768"
[  828.430575] env[65478]:    _type = "Task"
[  828.430575] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  828.442615] env[65478]: DEBUG oslo_vmware.api [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011768, 'name': Rename_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  828.485871] env[65478]: WARNING neutronclient.v2_0.client [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  828.531110] env[65478]: DEBUG oslo_vmware.api [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Task: {'id': task-6011765, 'name': ReconfigVM_Task, 'duration_secs': 0.374576} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  828.531365] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Reconfigured VM instance instance-0000001d to attach disk [datastore1] fbf21f21-d370-4a6a-ae24-0e6840464e24/fbf21f21-d370-4a6a-ae24-0e6840464e24.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  828.532098] env[65478]: DEBUG oslo_vmware.service [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-3811fc80-7f5e-424a-af3b-df252f543a9b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  828.543521] env[65478]: DEBUG oslo_vmware.api [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Waiting for the task: (returnval){
[  828.543521] env[65478]:    value = "task-6011769"
[  828.543521] env[65478]:    _type = "Task"
[  828.543521] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  828.554405] env[65478]: DEBUG oslo_vmware.api [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Task: {'id': task-6011769, 'name': Rename_Task} progress is 5%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  828.626261] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  828.627372] env[65478]: DEBUG nova.scheduler.client.report [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  828.708541] env[65478]: DEBUG nova.network.neutron [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Updating instance_info_cache with network_info: [{"id": "f0b49860-9c56-46f5-9519-2051bdc60f75", "address": "fa:16:3e:c8:ef:16", "network": {"id": "cf40b8d0-87c8-445d-9b09-7d7b98212c02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1605028920-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "8de0dd2b26b24b4fb6e13f475974035a", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "423047aa-c430-4593-a76c-9982c15c81cf", "external-id": "nsx-vlan-transportzone-262", "segmentation_id": 262, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapf0b49860-9c", "ovs_interfaceid": "f0b49860-9c56-46f5-9519-2051bdc60f75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  828.731433] env[65478]: WARNING neutronclient.v2_0.client [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  828.762278] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011766, 'name': CopyVirtualDisk_Task} progress is 51%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  828.943927] env[65478]: DEBUG oslo_vmware.api [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011768, 'name': Rename_Task, 'duration_secs': 0.22544} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  828.944269] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  828.944539] env[65478]: DEBUG oslo_vmware.service [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-94fbf383-3b4d-4f62-836c-0572b0ef5b8e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  828.956050] env[65478]: WARNING neutronclient.v2_0.client [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  828.958604] env[65478]: DEBUG oslo_vmware.api [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[  828.958604] env[65478]:    value = "task-6011770"
[  828.958604] env[65478]:    _type = "Task"
[  828.958604] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  828.968195] env[65478]: DEBUG oslo_vmware.api [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011770, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  829.048782] env[65478]: DEBUG nova.network.neutron [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Updated VIF entry in instance network info cache for port ad31d75c-ffad-4983-9c4c-24cd6a13c154. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  829.050447] env[65478]: DEBUG nova.network.neutron [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Updating instance_info_cache with network_info: [{"id": "ad31d75c-ffad-4983-9c4c-24cd6a13c154", "address": "fa:16:3e:b0:a6:58", "network": {"id": "6cee7b68-cb51-4c00-b143-8061d7844510", "bridge": "br-int", "label": "tempest-ImagesOneServerTestJSON-1681313208-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f871a0b5d01940f3aac47d33c49fc4b3", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "29945b49-d2b8-449d-9531-437917f49839", "external-id": "nsx-vlan-transportzone-787", "segmentation_id": 787, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapad31d75c-ff", "ovs_interfaceid": "ad31d75c-ffad-4983-9c4c-24cd6a13c154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  829.057266] env[65478]: DEBUG oslo_vmware.api [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Task: {'id': task-6011769, 'name': Rename_Task, 'duration_secs': 0.246217} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  829.057472] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  829.057758] env[65478]: DEBUG oslo_vmware.service [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-7774339a-6142-43bf-a682-c804769428ab {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  829.068378] env[65478]: DEBUG oslo_vmware.api [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Waiting for the task: (returnval){
[  829.068378] env[65478]:    value = "task-6011771"
[  829.068378] env[65478]:    _type = "Task"
[  829.068378] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  829.084823] env[65478]: DEBUG oslo_vmware.api [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Task: {'id': task-6011771, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  829.134497] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.783s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  829.136323] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 13.057s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  829.136609] env[65478]: DEBUG nova.compute.manager [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  829.142705] env[65478]: DEBUG nova.objects.instance [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Lazy-loading 'resources' on Instance uuid caf7856c-4e51-4e6c-ad32-2088e15d5d8f {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  829.213024] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Releasing lock "refresh_cache-28200981-9217-4395-b0a8-c154624c7a1c" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  829.213024] env[65478]: DEBUG nova.compute.manager [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Instance network_info: |[{"id": "f0b49860-9c56-46f5-9519-2051bdc60f75", "address": "fa:16:3e:c8:ef:16", "network": {"id": "cf40b8d0-87c8-445d-9b09-7d7b98212c02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1605028920-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "8de0dd2b26b24b4fb6e13f475974035a", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "423047aa-c430-4593-a76c-9982c15c81cf", "external-id": "nsx-vlan-transportzone-262", "segmentation_id": 262, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapf0b49860-9c", "ovs_interfaceid": "f0b49860-9c56-46f5-9519-2051bdc60f75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  829.213326] env[65478]: DEBUG oslo_concurrency.lockutils [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Acquiring lock "d4d3cf75-1781-46ed-afb2-44e6f2c048e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  829.213326] env[65478]: DEBUG oslo_concurrency.lockutils [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Lock "d4d3cf75-1781-46ed-afb2-44e6f2c048e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  829.216344] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:c8:ef:16', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': '423047aa-c430-4593-a76c-9982c15c81cf', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': 'f0b49860-9c56-46f5-9519-2051bdc60f75', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  829.233083] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  829.233478] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  829.234099] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-59eee306-da6f-472e-aea1-f042d021e058 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  829.265796] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011766, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.645392} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  829.265984] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Copied Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] e9f84a20-8def-4f36-92eb-8625364f7024/e9f84a20-8def-4f36-92eb-8625364f7024.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  829.266101] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  829.268165] env[65478]: DEBUG oslo_vmware.service [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-6d7e8300-06c6-4f84-a47d-5cb40f3c7f42 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  829.271112] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  829.271112] env[65478]:    value = "task-6011772"
[  829.271112] env[65478]:    _type = "Task"
[  829.271112] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  829.281177] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Waiting for the task: (returnval){
[  829.281177] env[65478]:    value = "task-6011773"
[  829.281177] env[65478]:    _type = "Task"
[  829.281177] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  829.301024] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011772, 'name': CreateVM_Task} progress is 10%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  829.305052] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011773, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  829.456197] env[65478]: WARNING nova.utils [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d9381a7880> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  829.473643] env[65478]: DEBUG oslo_vmware.api [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011770, 'name': PowerOnVM_Task} progress is 66%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  829.553791] env[65478]: DEBUG oslo_concurrency.lockutils [req-a7252ae1-7c1b-4edb-bed8-392a467d3961 req-26631d6d-4279-4f54-9b39-69deb2cb58e5 service nova] Releasing lock "refresh_cache-e9f84a20-8def-4f36-92eb-8625364f7024" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  829.582854] env[65478]: DEBUG oslo_vmware.api [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Task: {'id': task-6011771, 'name': PowerOnVM_Task} progress is 100%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  829.637829] env[65478]: DEBUG nova.compute.manager [req-dd77804d-58ff-49e7-b4a9-3ac30493ea22 req-098a1cf1-75af-41ef-a1c8-f322aada8751 service nova] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Received event network-vif-plugged-f0b49860-9c56-46f5-9519-2051bdc60f75 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  829.640530] env[65478]: DEBUG oslo_concurrency.lockutils [req-dd77804d-58ff-49e7-b4a9-3ac30493ea22 req-098a1cf1-75af-41ef-a1c8-f322aada8751 service nova] Acquiring lock "28200981-9217-4395-b0a8-c154624c7a1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  829.641983] env[65478]: DEBUG oslo_concurrency.lockutils [req-dd77804d-58ff-49e7-b4a9-3ac30493ea22 req-098a1cf1-75af-41ef-a1c8-f322aada8751 service nova] Lock "28200981-9217-4395-b0a8-c154624c7a1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  829.641983] env[65478]: DEBUG oslo_concurrency.lockutils [req-dd77804d-58ff-49e7-b4a9-3ac30493ea22 req-098a1cf1-75af-41ef-a1c8-f322aada8751 service nova] Lock "28200981-9217-4395-b0a8-c154624c7a1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  829.641983] env[65478]: DEBUG nova.compute.manager [req-dd77804d-58ff-49e7-b4a9-3ac30493ea22 req-098a1cf1-75af-41ef-a1c8-f322aada8751 service nova] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] No waiting events found dispatching network-vif-plugged-f0b49860-9c56-46f5-9519-2051bdc60f75 {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  829.643263] env[65478]: WARNING nova.compute.manager [req-dd77804d-58ff-49e7-b4a9-3ac30493ea22 req-098a1cf1-75af-41ef-a1c8-f322aada8751 service nova] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Received unexpected event network-vif-plugged-f0b49860-9c56-46f5-9519-2051bdc60f75 for instance with vm_state building and task_state spawning.
[  829.643263] env[65478]: DEBUG nova.compute.manager [req-dd77804d-58ff-49e7-b4a9-3ac30493ea22 req-098a1cf1-75af-41ef-a1c8-f322aada8751 service nova] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Received event network-changed-f0b49860-9c56-46f5-9519-2051bdc60f75 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  829.643263] env[65478]: DEBUG nova.compute.manager [req-dd77804d-58ff-49e7-b4a9-3ac30493ea22 req-098a1cf1-75af-41ef-a1c8-f322aada8751 service nova] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Refreshing instance network info cache due to event network-changed-f0b49860-9c56-46f5-9519-2051bdc60f75. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  829.643263] env[65478]: DEBUG oslo_concurrency.lockutils [req-dd77804d-58ff-49e7-b4a9-3ac30493ea22 req-098a1cf1-75af-41ef-a1c8-f322aada8751 service nova] Acquiring lock "refresh_cache-28200981-9217-4395-b0a8-c154624c7a1c" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  829.643263] env[65478]: DEBUG oslo_concurrency.lockutils [req-dd77804d-58ff-49e7-b4a9-3ac30493ea22 req-098a1cf1-75af-41ef-a1c8-f322aada8751 service nova] Acquired lock "refresh_cache-28200981-9217-4395-b0a8-c154624c7a1c" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  829.643524] env[65478]: DEBUG nova.network.neutron [req-dd77804d-58ff-49e7-b4a9-3ac30493ea22 req-098a1cf1-75af-41ef-a1c8-f322aada8751 service nova] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Refreshing network info cache for port f0b49860-9c56-46f5-9519-2051bdc60f75 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  829.649193] env[65478]: WARNING nova.utils [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] The MainProcess.default pool does not have free threads so the task <bound method ComputeManager._allocate_network_async of <nova.compute.manager.ComputeManager object at 0x73d94c2e6500>> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  829.650182] env[65478]: DEBUG nova.compute.utils [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  829.734244] env[65478]: DEBUG nova.compute.manager [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: d4d3cf75-1781-46ed-afb2-44e6f2c048e2] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  829.787071] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011772, 'name': CreateVM_Task, 'duration_secs': 0.433969} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  829.792719] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  829.795399] env[65478]: WARNING neutronclient.v2_0.client [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  829.795939] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  829.803092] env[65478]: WARNING nova.utils [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d92069d360> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  829.803092] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  829.807308] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011773, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.075482} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  829.808324] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Acquired external semaphore "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  829.808691] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  829.809791] env[65478]: DEBUG oslo_vmware.service [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-abe1aed4-0e34-42b7-95e0-8e733af599b6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  829.812604] env[65478]: DEBUG oslo_vmware.service [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0a183069-428a-4c93-9f13-d27b64e8ef97 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  829.819262] env[65478]: DEBUG oslo_vmware.api [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for the task: (returnval){
[  829.819262] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52b75ec5-0354-5b2f-db65-82b02b6daed9"
[  829.819262] env[65478]:    _type = "Task"
[  829.819262] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  829.847879] env[65478]: DEBUG oslo_vmware.api [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52b75ec5-0354-5b2f-db65-82b02b6daed9, 'name': SearchDatastore_Task, 'duration_secs': 0.010035} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  829.854045] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  829.854045] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  829.854045] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  829.855238] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  829.855238] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Creating directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  829.855238] env[65478]: DEBUG oslo_vmware.service [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-e83d380b-2d38-4f7a-8b3b-f2e7b8e30eb9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  829.860709] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Reconfiguring VM instance instance-0000001f to attach disk [datastore1] e9f84a20-8def-4f36-92eb-8625364f7024/e9f84a20-8def-4f36-92eb-8625364f7024.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  829.862041] env[65478]: DEBUG oslo_vmware.service [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-f398971b-481e-4f5f-be47-81f5f112db37 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  829.876499] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Created directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  829.880863] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Folder [datastore1] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  829.881863] env[65478]: DEBUG oslo_vmware.service [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-bc664150-d18d-4d06-be2e-bc4fddaeed3f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  829.900998] env[65478]: DEBUG oslo_vmware.api [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for the task: (returnval){
[  829.900998] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]5257d15c-8f9e-8d37-aedc-632f5f9ca858"
[  829.900998] env[65478]:    _type = "Task"
[  829.900998] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  829.908023] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Waiting for the task: (returnval){
[  829.908023] env[65478]:    value = "task-6011774"
[  829.908023] env[65478]:    _type = "Task"
[  829.908023] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  829.925276] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011774, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  829.928856] env[65478]: DEBUG oslo_vmware.api [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5257d15c-8f9e-8d37-aedc-632f5f9ca858, 'name': SearchDatastore_Task, 'duration_secs': 0.015514} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  829.929877] env[65478]: DEBUG oslo_vmware.service [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-4196c176-ee38-42a6-9e04-36e7c20a9bea {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  829.936999] env[65478]: DEBUG oslo_vmware.api [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for the task: (returnval){
[  829.936999] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]5241cced-1a04-cd9e-64bb-d25357764dee"
[  829.936999] env[65478]:    _type = "Task"
[  829.936999] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  829.947963] env[65478]: DEBUG oslo_vmware.api [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5241cced-1a04-cd9e-64bb-d25357764dee, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  829.971869] env[65478]: DEBUG oslo_vmware.api [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011770, 'name': PowerOnVM_Task, 'duration_secs': 0.789531} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  829.972473] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  829.972473] env[65478]: INFO nova.compute.manager [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Took 9.63 seconds to spawn the instance on the hypervisor.
[  829.972473] env[65478]: DEBUG nova.compute.manager [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  829.973215] env[65478]: DEBUG oslo_vmware.service [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-253e2e78-d4e5-4b54-aa9c-2bea500ae32c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  829.995991] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Acquiring lock "eb466e5e-a499-4856-9c12-c7ca87b53230" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  829.996202] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Lock "eb466e5e-a499-4856-9c12-c7ca87b53230" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  829.996440] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Acquiring lock "eb466e5e-a499-4856-9c12-c7ca87b53230-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  829.996529] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Lock "eb466e5e-a499-4856-9c12-c7ca87b53230-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  829.996658] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Lock "eb466e5e-a499-4856-9c12-c7ca87b53230-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  829.999836] env[65478]: INFO nova.compute.manager [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Terminating instance
[  830.079758] env[65478]: DEBUG oslo_vmware.api [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Task: {'id': task-6011771, 'name': PowerOnVM_Task, 'duration_secs': 0.572803} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  830.080032] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  830.080219] env[65478]: INFO nova.compute.manager [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Took 12.19 seconds to spawn the instance on the hypervisor.
[  830.080360] env[65478]: DEBUG nova.compute.manager [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  830.081256] env[65478]: DEBUG oslo_vmware.service [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-dc7a03b7-edf8-4ae2-9fa7-669e75284a05 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  830.149237] env[65478]: WARNING neutronclient.v2_0.client [req-dd77804d-58ff-49e7-b4a9-3ac30493ea22 req-098a1cf1-75af-41ef-a1c8-f322aada8751 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  830.161732] env[65478]: DEBUG nova.compute.utils [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  830.243044] env[65478]: DEBUG oslo_vmware.service [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f5dcea64-5dd3-4ed5-bba1-b73f8e16735d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  830.253461] env[65478]: DEBUG oslo_vmware.service [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d2d1abaf-1507-489a-942c-aa7f4b8c9d5d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  830.281711] env[65478]: DEBUG oslo_concurrency.lockutils [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  830.292683] env[65478]: DEBUG oslo_vmware.service [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0637ee83-f984-4761-b65c-59e008f3d774 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  830.304080] env[65478]: DEBUG oslo_vmware.service [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e5ff90aa-a114-4549-9683-46b25e9b207a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  830.326962] env[65478]: DEBUG nova.compute.provider_tree [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  830.419703] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011774, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  830.450310] env[65478]: DEBUG oslo_vmware.api [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5241cced-1a04-cd9e-64bb-d25357764dee, 'name': SearchDatastore_Task, 'duration_secs': 0.017231} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  830.450475] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  830.450694] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Copying Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 28200981-9217-4395-b0a8-c154624c7a1c/28200981-9217-4395-b0a8-c154624c7a1c.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  830.450946] env[65478]: DEBUG oslo_vmware.service [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-726748d8-ae1e-4957-a00d-79402a63b6e1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  830.460423] env[65478]: DEBUG oslo_vmware.api [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for the task: (returnval){
[  830.460423] env[65478]:    value = "task-6011777"
[  830.460423] env[65478]:    _type = "Task"
[  830.460423] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  830.469706] env[65478]: DEBUG oslo_vmware.api [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011777, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  830.495572] env[65478]: INFO nova.compute.manager [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Took 20.61 seconds to build instance.
[  830.503730] env[65478]: DEBUG nova.compute.manager [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[  830.503807] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  830.505064] env[65478]: DEBUG oslo_vmware.service [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c14202e6-f625-41a2-9b56-81d9779c58b4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  830.515286] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  830.515286] env[65478]: DEBUG oslo_vmware.service [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-1f71d3c3-726e-4ee3-941b-7c2a6812de1c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  830.525327] env[65478]: DEBUG oslo_vmware.api [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Waiting for the task: (returnval){
[  830.525327] env[65478]:    value = "task-6011778"
[  830.525327] env[65478]:    _type = "Task"
[  830.525327] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  830.536471] env[65478]: DEBUG oslo_vmware.api [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Task: {'id': task-6011778, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  830.609588] env[65478]: INFO nova.compute.manager [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Took 27.31 seconds to build instance.
[  830.666538] env[65478]: DEBUG nova.compute.manager [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  830.861899] env[65478]: ERROR nova.scheduler.client.report [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] [req-da316219-d7f3-49b3-86b5-24b49eafebb8] Failed to update inventory to [{'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}}] for resource provider with UUID e3a5020e-0218-494b-ae38-8b55aa77f6f5.  Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n resource provider generation conflict  ", "code": "placement.concurrent_update", "request_id": "req-da316219-d7f3-49b3-86b5-24b49eafebb8"}]}
[  830.897902] env[65478]: DEBUG nova.scheduler.client.report [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Refreshing inventories for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
[  830.926205] env[65478]: DEBUG nova.scheduler.client.report [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Updating ProviderTree inventory for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
[  830.927254] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011774, 'name': ReconfigVM_Task, 'duration_secs': 0.828214} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  830.927662] env[65478]: WARNING neutronclient.v2_0.client [req-dd77804d-58ff-49e7-b4a9-3ac30493ea22 req-098a1cf1-75af-41ef-a1c8-f322aada8751 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  830.929119] env[65478]: DEBUG nova.compute.provider_tree [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  830.931264] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Reconfigured VM instance instance-0000001f to attach disk [datastore1] e9f84a20-8def-4f36-92eb-8625364f7024/e9f84a20-8def-4f36-92eb-8625364f7024.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  830.933229] env[65478]: DEBUG oslo_vmware.service [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-78a59530-e799-4839-bc37-f6c5cd0d7a9b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  830.946722] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Waiting for the task: (returnval){
[  830.946722] env[65478]:    value = "task-6011779"
[  830.946722] env[65478]:    _type = "Task"
[  830.946722] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  830.960055] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011779, 'name': Rename_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  830.968815] env[65478]: DEBUG nova.scheduler.client.report [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Refreshing aggregate associations for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5, aggregates: None {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
[  830.973874] env[65478]: DEBUG oslo_vmware.api [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011777, 'name': CopyVirtualDisk_Task} progress is 77%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  830.994795] env[65478]: DEBUG oslo_concurrency.lockutils [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Acquiring lock "98b2d40a-0c59-4540-b60e-17e5206dea42" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  830.995710] env[65478]: DEBUG oslo_concurrency.lockutils [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Lock "98b2d40a-0c59-4540-b60e-17e5206dea42" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  830.999027] env[65478]: DEBUG nova.scheduler.client.report [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Refreshing trait associations for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_VMDK,COMPUTE_IMAGE_TYPE_ISO,HW_ARCH_X86_64,COMPUTE_SAME_HOST_COLD_MIGRATE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
[  831.001193] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4e13bc59-6b57-4936-84ab-3b805ee989fd tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "f37353fc-a5c5-41db-9d2c-c1f286fe321b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.143s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  831.002225] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Acquiring lock "ec1a8c79-d97b-4eb0-b024-1b0c86ccab17" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  831.002963] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Lock "ec1a8c79-d97b-4eb0-b024-1b0c86ccab17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  831.042690] env[65478]: DEBUG oslo_vmware.api [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Task: {'id': task-6011778, 'name': PowerOffVM_Task, 'duration_secs': 0.288904} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  831.044291] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  831.044623] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  831.045016] env[65478]: DEBUG oslo_vmware.service [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-78141861-9a3e-462f-844e-f3a6c94485bd {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  831.069412] env[65478]: DEBUG nova.network.neutron [req-dd77804d-58ff-49e7-b4a9-3ac30493ea22 req-098a1cf1-75af-41ef-a1c8-f322aada8751 service nova] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Updated VIF entry in instance network info cache for port f0b49860-9c56-46f5-9519-2051bdc60f75. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  831.069767] env[65478]: DEBUG nova.network.neutron [req-dd77804d-58ff-49e7-b4a9-3ac30493ea22 req-098a1cf1-75af-41ef-a1c8-f322aada8751 service nova] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Updating instance_info_cache with network_info: [{"id": "f0b49860-9c56-46f5-9519-2051bdc60f75", "address": "fa:16:3e:c8:ef:16", "network": {"id": "cf40b8d0-87c8-445d-9b09-7d7b98212c02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1605028920-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "8de0dd2b26b24b4fb6e13f475974035a", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "423047aa-c430-4593-a76c-9982c15c81cf", "external-id": "nsx-vlan-transportzone-262", "segmentation_id": 262, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapf0b49860-9c", "ovs_interfaceid": "f0b49860-9c56-46f5-9519-2051bdc60f75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  831.111832] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b3a28bf0-bf53-4ab5-b1d0-8908044a37c6 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Lock "fbf21f21-d370-4a6a-ae24-0e6840464e24" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.823s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  831.112117] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Acquiring lock "25ec70f9-947b-4ebe-82df-1a1ddcc59360" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  831.112335] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Lock "25ec70f9-947b-4ebe-82df-1a1ddcc59360" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  831.126382] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  831.126643] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Deleting contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  831.126722] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Deleting the datastore file [datastore1] eb466e5e-a499-4856-9c12-c7ca87b53230 {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  831.127653] env[65478]: DEBUG oslo_vmware.service [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-1fd0750f-82f4-4255-abf0-46405dd8d48e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  831.143567] env[65478]: DEBUG oslo_vmware.api [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Waiting for the task: (returnval){
[  831.143567] env[65478]:    value = "task-6011781"
[  831.143567] env[65478]:    _type = "Task"
[  831.143567] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  831.168763] env[65478]: DEBUG oslo_vmware.api [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Task: {'id': task-6011781, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  831.235376] env[65478]: WARNING nova.utils [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d9381a4d30> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  831.458141] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011779, 'name': Rename_Task, 'duration_secs': 0.237922} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  831.459267] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  831.459591] env[65478]: DEBUG oslo_vmware.service [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-0f808322-3bb4-4bbb-ab05-ee52cacf5bfa {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  831.470640] env[65478]: DEBUG oslo_vmware.api [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011777, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.532201} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  831.470848] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Copied Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] 28200981-9217-4395-b0a8-c154624c7a1c/28200981-9217-4395-b0a8-c154624c7a1c.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  831.473285] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  831.476868] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Waiting for the task: (returnval){
[  831.476868] env[65478]:    value = "task-6011782"
[  831.476868] env[65478]:    _type = "Task"
[  831.476868] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  831.481837] env[65478]: DEBUG oslo_vmware.service [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-7b569011-422c-4f26-9e24-7790d8979556 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  831.505813] env[65478]: DEBUG oslo_vmware.api [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for the task: (returnval){
[  831.505813] env[65478]:    value = "task-6011783"
[  831.505813] env[65478]:    _type = "Task"
[  831.505813] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  831.509792] env[65478]: DEBUG nova.compute.utils [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  831.521943] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011782, 'name': PowerOnVM_Task} progress is 33%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  831.527250] env[65478]: DEBUG nova.compute.manager [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] [instance: ec1a8c79-d97b-4eb0-b024-1b0c86ccab17] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  831.529985] env[65478]: DEBUG oslo_vmware.api [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011783, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  831.558375] env[65478]: DEBUG oslo_vmware.service [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-5df2a689-63dc-4431-8c0e-49446d0e968b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  831.568926] env[65478]: DEBUG oslo_vmware.service [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-7e2af5d9-9e9e-4ac7-b8dc-34aa4a4b7484 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  831.576018] env[65478]: DEBUG oslo_concurrency.lockutils [req-dd77804d-58ff-49e7-b4a9-3ac30493ea22 req-098a1cf1-75af-41ef-a1c8-f322aada8751 service nova] Releasing lock "refresh_cache-28200981-9217-4395-b0a8-c154624c7a1c" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  831.605073] env[65478]: DEBUG oslo_vmware.service [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-17c24942-6b7a-4f88-b805-91c0cb3a1325 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  831.615214] env[65478]: DEBUG oslo_vmware.service [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6d41660c-8c1f-4b4d-8187-80e3bae90543 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  831.620248] env[65478]: DEBUG nova.compute.manager [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] [instance: 25ec70f9-947b-4ebe-82df-1a1ddcc59360] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  831.635117] env[65478]: DEBUG nova.compute.provider_tree [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  831.658031] env[65478]: DEBUG oslo_vmware.api [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Task: {'id': task-6011781, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.160119} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  831.658031] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  831.658342] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Deleted contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  831.658342] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  831.658426] env[65478]: INFO nova.compute.manager [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Took 1.15 seconds to destroy the instance on the hypervisor.
[  831.659866] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  831.659866] env[65478]: DEBUG nova.compute.manager [-] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[  831.659866] env[65478]: DEBUG nova.network.neutron [-] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[  831.659866] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  831.682050] env[65478]: DEBUG nova.compute.manager [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  831.717707] env[65478]: DEBUG nova.virt.hardware [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:37:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=1,extra_specs={hw_rng:allowed='True'},flavorid='1650445480',id=19,is_public=True,memory_mb=192,name='tempest-flavor_with_ephemeral_1-1128415523',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  831.717707] env[65478]: DEBUG nova.virt.hardware [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  831.717707] env[65478]: DEBUG nova.virt.hardware [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  831.717894] env[65478]: DEBUG nova.virt.hardware [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  831.717894] env[65478]: DEBUG nova.virt.hardware [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  831.719151] env[65478]: DEBUG nova.virt.hardware [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  831.719277] env[65478]: DEBUG nova.virt.hardware [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  831.719441] env[65478]: DEBUG nova.virt.hardware [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  831.719598] env[65478]: DEBUG nova.virt.hardware [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  831.719747] env[65478]: DEBUG nova.virt.hardware [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  831.719862] env[65478]: DEBUG nova.virt.hardware [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  831.720843] env[65478]: DEBUG oslo_vmware.service [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-86b8015a-c36e-46a0-9c8b-8f815ca6671b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  831.736175] env[65478]: DEBUG oslo_vmware.service [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d0a85d53-1f84-4b87-b5cb-be56e8cf0498 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  831.767786] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  831.993588] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011782, 'name': PowerOnVM_Task} progress is 76%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  832.016148] env[65478]: DEBUG oslo_vmware.api [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011783, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.098827} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  832.016551] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  832.017549] env[65478]: DEBUG oslo_vmware.service [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0052f429-891b-4a29-a1a9-5a055d584df8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  832.030517] env[65478]: DEBUG oslo_concurrency.lockutils [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Lock "98b2d40a-0c59-4540-b60e-17e5206dea42" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.034s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  832.051678] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Reconfiguring VM instance instance-00000020 to attach disk [datastore1] 28200981-9217-4395-b0a8-c154624c7a1c/28200981-9217-4395-b0a8-c154624c7a1c.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  832.052394] env[65478]: DEBUG oslo_vmware.service [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-1f0848eb-b21e-4c46-88e1-c1c727d37881 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  832.083187] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  832.085675] env[65478]: DEBUG oslo_vmware.api [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for the task: (returnval){
[  832.085675] env[65478]:    value = "task-6011784"
[  832.085675] env[65478]:    _type = "Task"
[  832.085675] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  832.097171] env[65478]: DEBUG oslo_vmware.api [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011784, 'name': ReconfigVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  832.138623] env[65478]: DEBUG nova.scheduler.client.report [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  832.154434] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  832.353783] env[65478]: WARNING nova.utils [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d9381101f0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  832.492230] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011782, 'name': PowerOnVM_Task} progress is 100%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  832.615623] env[65478]: DEBUG oslo_vmware.api [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011784, 'name': ReconfigVM_Task, 'duration_secs': 0.427971} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  832.615978] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Reconfigured VM instance instance-00000020 to attach disk [datastore1] 28200981-9217-4395-b0a8-c154624c7a1c/28200981-9217-4395-b0a8-c154624c7a1c.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  832.617149] env[65478]: DEBUG oslo_vmware.service [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-63c0a578-528f-4de4-91e9-fd570acd5477 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  832.627345] env[65478]: DEBUG oslo_vmware.api [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for the task: (returnval){
[  832.627345] env[65478]:    value = "task-6011786"
[  832.627345] env[65478]:    _type = "Task"
[  832.627345] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  832.646231] env[65478]: DEBUG oslo_vmware.api [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011786, 'name': Rename_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  832.648614] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 3.512s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  832.652809] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 15.845s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  832.652809] env[65478]: DEBUG nova.objects.instance [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Lazy-loading 'resources' on Instance uuid eb076624-c76c-47da-9320-5fc13a51b365 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  832.697649] env[65478]: INFO nova.scheduler.client.report [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Deleted allocations for instance caf7856c-4e51-4e6c-ad32-2088e15d5d8f
[  832.847783] env[65478]: DEBUG nova.network.neutron [-] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  832.991778] env[65478]: DEBUG oslo_vmware.api [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011782, 'name': PowerOnVM_Task, 'duration_secs': 1.057331} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  832.992865] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  832.993639] env[65478]: INFO nova.compute.manager [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Took 10.20 seconds to spawn the instance on the hypervisor.
[  832.993639] env[65478]: DEBUG nova.compute.manager [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  832.995793] env[65478]: DEBUG oslo_vmware.service [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e573ea66-99cb-4a7a-9f6e-5ca7e9fb1961 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  833.111413] env[65478]: DEBUG oslo_concurrency.lockutils [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Acquiring lock "98b2d40a-0c59-4540-b60e-17e5206dea42" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  833.111538] env[65478]: DEBUG oslo_concurrency.lockutils [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Lock "98b2d40a-0c59-4540-b60e-17e5206dea42" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  833.111821] env[65478]: INFO nova.compute.manager [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Attaching volume 40f82a17-27d1-4c63-987b-11d774c1afea to /dev/sdb
[  833.140205] env[65478]: DEBUG oslo_vmware.api [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011786, 'name': Rename_Task, 'duration_secs': 0.286355} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  833.140438] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  833.140743] env[65478]: DEBUG oslo_vmware.service [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-b220e9bc-2db4-4b9a-a45f-7953d607ca5c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  833.148749] env[65478]: DEBUG oslo_vmware.api [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for the task: (returnval){
[  833.148749] env[65478]:    value = "task-6011787"
[  833.148749] env[65478]:    _type = "Task"
[  833.148749] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  833.159365] env[65478]: DEBUG oslo_vmware.api [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011787, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  833.165129] env[65478]: DEBUG oslo_vmware.service [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-47b89714-3768-470b-aad6-4b04fca99be2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  833.174148] env[65478]: DEBUG oslo_vmware.service [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e79e47b5-4cab-4d57-ba3c-8b5305ea4bb8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  833.192355] env[65478]: DEBUG nova.virt.block_device [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Updating existing volume attachment record: 85fa1431-0ca4-4bf2-b560-9be69b4230ae {{(pid=65478) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
[  833.213669] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8a8ff462-cd09-43aa-ae41-8753e50ca320 tempest-FloatingIPsAssociationTestJSON-472239000 tempest-FloatingIPsAssociationTestJSON-472239000-project-member] Lock "caf7856c-4e51-4e6c-ad32-2088e15d5d8f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 21.655s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  833.350630] env[65478]: INFO nova.compute.manager [-] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Took 1.69 seconds to deallocate network for instance.
[  833.369118] env[65478]: DEBUG nova.compute.manager [req-a9fe4252-d53b-4ba4-942d-bb1ab3877e23 req-d85b0bbe-3426-4163-a5d3-e2f31894579a service nova] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Received event network-vif-deleted-fe1047e6-be6d-4718-a53e-e21e2b96dcc9 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  833.522797] env[65478]: INFO nova.compute.manager [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Took 22.52 seconds to build instance.
[  833.636197] env[65478]: DEBUG oslo_vmware.service [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f4cc72eb-e0e2-456b-97a7-ee1be45410ba {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  833.646407] env[65478]: DEBUG oslo_vmware.service [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-37a527eb-fa18-4823-adcd-a09a66797c0b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  833.665464] env[65478]: DEBUG oslo_vmware.api [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011787, 'name': PowerOnVM_Task} progress is 88%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  833.702764] env[65478]: DEBUG oslo_vmware.service [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f60d1d0a-e2f4-4f2d-8dfc-f359f024687b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  833.713690] env[65478]: DEBUG oslo_vmware.service [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8c85b560-9e5b-474a-b930-6f76f2ff6c40 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  833.733143] env[65478]: DEBUG nova.compute.provider_tree [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  833.864029] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  834.025446] env[65478]: DEBUG oslo_concurrency.lockutils [None req-805e611a-ab2b-4b67-97f4-90e56b419ed8 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Lock "e9f84a20-8def-4f36-92eb-8625364f7024" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.064s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  834.025446] env[65478]: DEBUG nova.compute.manager [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Allocating IP information in the background. {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}}
[  834.025446] env[65478]: DEBUG nova.network.neutron [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] allocate_for_instance() {{(pid=65478) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
[  834.025446] env[65478]: WARNING neutronclient.v2_0.client [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  834.031466] env[65478]: WARNING neutronclient.v2_0.client [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  834.166105] env[65478]: DEBUG oslo_vmware.api [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011787, 'name': PowerOnVM_Task, 'duration_secs': 0.875209} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  834.167520] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  834.167520] env[65478]: INFO nova.compute.manager [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Took 7.99 seconds to spawn the instance on the hypervisor.
[  834.167520] env[65478]: DEBUG nova.compute.manager [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  834.168056] env[65478]: DEBUG oslo_vmware.service [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ff7bb92f-12f4-4b83-b869-4429d04218ae {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  834.210081] env[65478]: WARNING nova.utils [None req-c8902b56-7786-46df-9c11-c7dde54c7acc tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d938110280> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  834.236181] env[65478]: DEBUG nova.scheduler.client.report [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  834.691407] env[65478]: INFO nova.compute.manager [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Took 21.97 seconds to build instance.
[  834.742134] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.096s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  834.746794] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 13.644s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  834.750787] env[65478]: INFO nova.compute.claims [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] [instance: 77a0e8c4-b77a-45b9-a249-d98866d4048a] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  834.775762] env[65478]: INFO nova.scheduler.client.report [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Deleted allocations for instance eb076624-c76c-47da-9320-5fc13a51b365
[  834.814225] env[65478]: WARNING nova.utils [None req-97ce6744-6860-4534-b094-9cb17906ffb6 tempest-ServersTestBootFromVolume-1179861479 tempest-ServersTestBootFromVolume-1179861479-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8fc72eb90> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  834.969225] env[65478]: DEBUG nova.policy [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1dcf390fa3b048ed98b3069887a6b7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70efc035843c47d69ec6a42f446a2b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65478) authorize /opt/stack/nova/nova/policy.py:192}}
[  835.193235] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c45eefa6-3e99-43ae-bec5-ab742c5d9568 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Lock "28200981-9217-4395-b0a8-c154624c7a1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.481s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  835.193235] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Acquiring lock "8d032b6f-86df-4397-8727-d4336f973368" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  835.193655] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Lock "8d032b6f-86df-4397-8727-d4336f973368" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  835.286046] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0eeab5e9-319f-43f9-9957-339103d55dea tempest-FloatingIPsAssociationNegativeTestJSON-1630294498 tempest-FloatingIPsAssociationNegativeTestJSON-1630294498-project-member] Lock "eb076624-c76c-47da-9320-5fc13a51b365" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 22.720s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  835.697940] env[65478]: DEBUG nova.compute.manager [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] [instance: 8d032b6f-86df-4397-8727-d4336f973368] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  835.715337] env[65478]: DEBUG nova.network.neutron [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Successfully created port: d0ba0aff-4125-4028-bb87-c0e783d1e066 {{(pid=65478) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
[  836.228514] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  836.292893] env[65478]: DEBUG oslo_vmware.service [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-df330485-f50e-48e5-85a5-f6d1455e65d5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  836.307785] env[65478]: DEBUG oslo_vmware.service [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-df8780b9-956a-443a-a194-c5c10728a60c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  836.347728] env[65478]: DEBUG oslo_vmware.service [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-01c2e630-6748-4c75-94af-b9f7994fe9a1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  836.355165] env[65478]: DEBUG oslo_vmware.service [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-96c528d3-f7e4-487b-b3f7-6a307ffb23b0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  836.376693] env[65478]: DEBUG nova.compute.provider_tree [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  836.902449] env[65478]: ERROR nova.scheduler.client.report [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] [req-07f4f141-72b9-494b-9393-a73d7bc9443f] Failed to update inventory to [{'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}}] for resource provider with UUID e3a5020e-0218-494b-ae38-8b55aa77f6f5.  Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n resource provider generation conflict  ", "code": "placement.concurrent_update", "request_id": "req-07f4f141-72b9-494b-9393-a73d7bc9443f"}]}
[  836.939176] env[65478]: DEBUG nova.scheduler.client.report [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Refreshing inventories for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
[  836.970159] env[65478]: DEBUG nova.scheduler.client.report [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Updating ProviderTree inventory for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
[  836.970377] env[65478]: DEBUG nova.compute.provider_tree [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  836.992043] env[65478]: DEBUG nova.scheduler.client.report [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Refreshing aggregate associations for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5, aggregates: None {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
[  837.017778] env[65478]: DEBUG nova.scheduler.client.report [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Refreshing trait associations for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_VMDK,COMPUTE_IMAGE_TYPE_ISO,HW_ARCH_X86_64,COMPUTE_SAME_HOST_COLD_MIGRATE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
[  837.474154] env[65478]: DEBUG oslo_vmware.service [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-01fbdb13-7357-4976-aff5-7718448a1ed7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  837.482753] env[65478]: DEBUG oslo_vmware.service [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d2472b3e-c176-4886-9f26-e5c12eb44d5a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  837.518699] env[65478]: DEBUG oslo_vmware.service [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b94f84f4-7d7b-4605-8194-3088c2cb4c73 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  837.528823] env[65478]: DEBUG oslo_vmware.service [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-fbd9819b-ab88-4029-bf4a-05816663c570 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  837.545965] env[65478]: DEBUG nova.compute.provider_tree [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  837.785299] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Volume attach. Driver type: vmdk {{(pid=65478) attach_volume /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:439}}
[  837.785614] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] _attach_volume_vmdk: {'driver_volume_type': 'vmdk', 'data': {'volume': 'vm-1161287', 'volume_id': '40f82a17-27d1-4c63-987b-11d774c1afea', 'name': 'volume-40f82a17-27d1-4c63-987b-11d774c1afea', 'profile_id': None, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'physical_block_size': '512', 'logical_block_size': '512', 'enforce_multipath': False}, 'status': 'reserved', 'instance': '98b2d40a-0c59-4540-b60e-17e5206dea42', 'attached_at': '', 'detached_at': '', 'volume_id': '40f82a17-27d1-4c63-987b-11d774c1afea', 'serial': '40f82a17-27d1-4c63-987b-11d774c1afea'} {{(pid=65478) _attach_volume_vmdk /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:336}}
[  837.787125] env[65478]: DEBUG oslo_vmware.service [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-7d0f84e7-9eae-4ea0-869f-d504cbfef175 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  837.815247] env[65478]: DEBUG oslo_vmware.service [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a8a6cd4f-7d1d-4f70-9c3d-f1b0993c193b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  837.856532] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Reconfiguring VM instance instance-0000000a to attach disk [datastore1] volume-40f82a17-27d1-4c63-987b-11d774c1afea/volume-40f82a17-27d1-4c63-987b-11d774c1afea.vmdk or device None with type thin {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  837.856532] env[65478]: DEBUG oslo_vmware.service [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-54831455-d560-4cdc-8682-fbfdd96e4216 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  837.891614] env[65478]: DEBUG oslo_vmware.api [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Waiting for the task: (returnval){
[  837.891614] env[65478]:    value = "task-6011794"
[  837.891614] env[65478]:    _type = "Task"
[  837.891614] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  837.903786] env[65478]: DEBUG oslo_vmware.api [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Task: {'id': task-6011794, 'name': ReconfigVM_Task} progress is 5%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  837.913298] env[65478]: DEBUG nova.network.neutron [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Successfully updated port: d0ba0aff-4125-4028-bb87-c0e783d1e066 {{(pid=65478) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
[  838.096425] env[65478]: DEBUG nova.scheduler.client.report [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Updated inventory for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with generation 58 in Placement from set_inventory_for_provider using data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}}
[  838.096638] env[65478]: DEBUG nova.compute.provider_tree [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Updating resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 generation from 58 to 59 during operation: update_inventory {{(pid=65478) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
[  838.096788] env[65478]: DEBUG nova.compute.provider_tree [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  838.409239] env[65478]: DEBUG oslo_vmware.api [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Task: {'id': task-6011794, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  838.427287] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Acquiring lock "refresh_cache-ef569806-5f50-44b9-a4a9-0107328a8dfe" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  838.427287] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Acquired lock "refresh_cache-ef569806-5f50-44b9-a4a9-0107328a8dfe" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  838.427287] env[65478]: DEBUG nova.network.neutron [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  838.604024] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.860s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  838.604024] env[65478]: DEBUG nova.compute.manager [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] [instance: 77a0e8c4-b77a-45b9-a249-d98866d4048a] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  838.606948] env[65478]: DEBUG oslo_concurrency.lockutils [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 12.116s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  838.609833] env[65478]: INFO nova.compute.claims [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] [instance: d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  838.623062] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[  838.625802] env[65478]: DEBUG nova.compute.manager [req-7689686a-7c9d-4de4-a2f6-d9642f7c1d3b req-6875185b-8c5a-4492-9b1f-582f106efed3 service nova] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Received event network-changed-2adf13cf-99c3-472f-bc02-769c66b01c29 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  838.626099] env[65478]: DEBUG nova.compute.manager [req-7689686a-7c9d-4de4-a2f6-d9642f7c1d3b req-6875185b-8c5a-4492-9b1f-582f106efed3 service nova] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Refreshing instance network info cache due to event network-changed-2adf13cf-99c3-472f-bc02-769c66b01c29. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  838.626296] env[65478]: DEBUG oslo_concurrency.lockutils [req-7689686a-7c9d-4de4-a2f6-d9642f7c1d3b req-6875185b-8c5a-4492-9b1f-582f106efed3 service nova] Acquiring lock "refresh_cache-fbf21f21-d370-4a6a-ae24-0e6840464e24" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  838.626446] env[65478]: DEBUG oslo_concurrency.lockutils [req-7689686a-7c9d-4de4-a2f6-d9642f7c1d3b req-6875185b-8c5a-4492-9b1f-582f106efed3 service nova] Acquired lock "refresh_cache-fbf21f21-d370-4a6a-ae24-0e6840464e24" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  838.626553] env[65478]: DEBUG nova.network.neutron [req-7689686a-7c9d-4de4-a2f6-d9642f7c1d3b req-6875185b-8c5a-4492-9b1f-582f106efed3 service nova] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Refreshing network info cache for port 2adf13cf-99c3-472f-bc02-769c66b01c29 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  838.904026] env[65478]: DEBUG oslo_vmware.api [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Task: {'id': task-6011794, 'name': ReconfigVM_Task, 'duration_secs': 0.66101} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  838.904311] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Reconfigured VM instance instance-0000000a to attach disk [datastore1] volume-40f82a17-27d1-4c63-987b-11d774c1afea/volume-40f82a17-27d1-4c63-987b-11d774c1afea.vmdk or device None with type thin {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  838.909346] env[65478]: DEBUG oslo_vmware.service [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-b7b1b947-82b2-4ee5-a285-a8abf8b59e2e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  838.938197] env[65478]: DEBUG oslo_vmware.api [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Waiting for the task: (returnval){
[  838.938197] env[65478]:    value = "task-6011796"
[  838.938197] env[65478]:    _type = "Task"
[  838.938197] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  838.948239] env[65478]: DEBUG oslo_vmware.api [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Task: {'id': task-6011796, 'name': ReconfigVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  838.982116] env[65478]: DEBUG nova.network.neutron [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Instance cache missing network info. {{(pid=65478) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
[  839.112178] env[65478]: WARNING nova.utils [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] The MainProcess.default pool does not have free threads so the task <bound method ComputeManager._allocate_network_async of <nova.compute.manager.ComputeManager object at 0x73d94c2e6500>> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  839.113053] env[65478]: DEBUG nova.compute.utils [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  839.132026] env[65478]: WARNING neutronclient.v2_0.client [req-7689686a-7c9d-4de4-a2f6-d9642f7c1d3b req-6875185b-8c5a-4492-9b1f-582f106efed3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  839.281501] env[65478]: WARNING neutronclient.v2_0.client [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  839.376857] env[65478]: DEBUG nova.compute.manager [req-c1b0cc1d-5a55-431d-ba2a-9e6bc9dd0577 req-e613b783-4d9f-4ff8-89c3-fd04de445a86 service nova] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Received event network-vif-plugged-d0ba0aff-4125-4028-bb87-c0e783d1e066 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  839.378032] env[65478]: DEBUG oslo_concurrency.lockutils [req-c1b0cc1d-5a55-431d-ba2a-9e6bc9dd0577 req-e613b783-4d9f-4ff8-89c3-fd04de445a86 service nova] Acquiring lock "ef569806-5f50-44b9-a4a9-0107328a8dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  839.378032] env[65478]: DEBUG oslo_concurrency.lockutils [req-c1b0cc1d-5a55-431d-ba2a-9e6bc9dd0577 req-e613b783-4d9f-4ff8-89c3-fd04de445a86 service nova] Lock "ef569806-5f50-44b9-a4a9-0107328a8dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  839.378032] env[65478]: DEBUG oslo_concurrency.lockutils [req-c1b0cc1d-5a55-431d-ba2a-9e6bc9dd0577 req-e613b783-4d9f-4ff8-89c3-fd04de445a86 service nova] Lock "ef569806-5f50-44b9-a4a9-0107328a8dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  839.378032] env[65478]: DEBUG nova.compute.manager [req-c1b0cc1d-5a55-431d-ba2a-9e6bc9dd0577 req-e613b783-4d9f-4ff8-89c3-fd04de445a86 service nova] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] No waiting events found dispatching network-vif-plugged-d0ba0aff-4125-4028-bb87-c0e783d1e066 {{(pid=65478) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
[  839.378032] env[65478]: WARNING nova.compute.manager [req-c1b0cc1d-5a55-431d-ba2a-9e6bc9dd0577 req-e613b783-4d9f-4ff8-89c3-fd04de445a86 service nova] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Received unexpected event network-vif-plugged-d0ba0aff-4125-4028-bb87-c0e783d1e066 for instance with vm_state building and task_state spawning.
[  839.448692] env[65478]: DEBUG oslo_vmware.api [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Task: {'id': task-6011796, 'name': ReconfigVM_Task, 'duration_secs': 0.27748} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  839.449555] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Attached VMDK: {'driver_volume_type': 'vmdk', 'data': {'volume': 'vm-1161287', 'volume_id': '40f82a17-27d1-4c63-987b-11d774c1afea', 'name': 'volume-40f82a17-27d1-4c63-987b-11d774c1afea', 'profile_id': None, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'physical_block_size': '512', 'logical_block_size': '512', 'enforce_multipath': False}, 'status': 'reserved', 'instance': '98b2d40a-0c59-4540-b60e-17e5206dea42', 'attached_at': '', 'detached_at': '', 'volume_id': '40f82a17-27d1-4c63-987b-11d774c1afea', 'serial': '40f82a17-27d1-4c63-987b-11d774c1afea'} {{(pid=65478) _attach_volume_vmdk /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:361}}
[  839.618407] env[65478]: DEBUG nova.network.neutron [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Updating instance_info_cache with network_info: [{"id": "d0ba0aff-4125-4028-bb87-c0e783d1e066", "address": "fa:16:3e:03:25:35", "network": {"id": "2ed010d6-4573-4056-a189-22d86fca4369", "bridge": "br-int", "label": "tempest-ServersWithSpecificFlavorTestJSON-2103777099-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "70efc035843c47d69ec6a42f446a2b91", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "b250e561-3be3-4bae-be1a-162251b1ee31", "external-id": "nsx-vlan-transportzone-464", "segmentation_id": 464, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapd0ba0aff-41", "ovs_interfaceid": "d0ba0aff-4125-4028-bb87-c0e783d1e066", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  839.619934] env[65478]: DEBUG nova.compute.manager [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] [instance: 77a0e8c4-b77a-45b9-a249-d98866d4048a] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  840.116141] env[65478]: DEBUG oslo_vmware.service [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e0e7f359-0e73-4607-8f66-237f3f9fe4ba {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  840.126661] env[65478]: DEBUG oslo_vmware.service [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-127525c9-3b9b-4c78-aeb4-18fe07d77ddd {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  840.130372] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Releasing lock "refresh_cache-ef569806-5f50-44b9-a4a9-0107328a8dfe" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  840.134295] env[65478]: DEBUG nova.compute.manager [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Instance network_info: |[{"id": "d0ba0aff-4125-4028-bb87-c0e783d1e066", "address": "fa:16:3e:03:25:35", "network": {"id": "2ed010d6-4573-4056-a189-22d86fca4369", "bridge": "br-int", "label": "tempest-ServersWithSpecificFlavorTestJSON-2103777099-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "70efc035843c47d69ec6a42f446a2b91", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "b250e561-3be3-4bae-be1a-162251b1ee31", "external-id": "nsx-vlan-transportzone-464", "segmentation_id": 464, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapd0ba0aff-41", "ovs_interfaceid": "d0ba0aff-4125-4028-bb87-c0e783d1e066", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}}
[  840.134969] env[65478]: DEBUG oslo_concurrency.lockutils [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] Acquiring lock "e2e07720-a241-4382-a684-0835b199e37d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  840.135855] env[65478]: DEBUG oslo_concurrency.lockutils [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] Lock "e2e07720-a241-4382-a684-0835b199e37d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  840.137485] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:03:25:35', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': 'b250e561-3be3-4bae-be1a-162251b1ee31', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': 'd0ba0aff-4125-4028-bb87-c0e783d1e066', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[  840.149856] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  840.159929] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[  840.161303] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-73285833-5b59-481c-8918-961688134cd5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  840.208839] env[65478]: DEBUG oslo_vmware.service [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-629e5575-8c5e-4547-aa73-013c21b4bfe5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  840.219782] env[65478]: DEBUG oslo_vmware.service [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6c8c9121-0fa7-4564-8e49-fa3d6aba35e6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  840.226704] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[  840.226704] env[65478]:    value = "task-6011797"
[  840.226704] env[65478]:    _type = "Task"
[  840.226704] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  840.246895] env[65478]: DEBUG nova.compute.provider_tree [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  840.255893] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011797, 'name': CreateVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  840.423980] env[65478]: DEBUG nova.compute.manager [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  840.424876] env[65478]: DEBUG oslo_vmware.service [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-427601ad-105b-4957-ab5c-cb5da58af39c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  840.517354] env[65478]: DEBUG nova.objects.instance [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Lazy-loading 'flavor' on Instance uuid 98b2d40a-0c59-4540-b60e-17e5206dea42 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  840.552256] env[65478]: WARNING neutronclient.v2_0.client [req-7689686a-7c9d-4de4-a2f6-d9642f7c1d3b req-6875185b-8c5a-4492-9b1f-582f106efed3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  840.640039] env[65478]: DEBUG nova.compute.manager [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] [instance: 77a0e8c4-b77a-45b9-a249-d98866d4048a] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  840.649494] env[65478]: DEBUG nova.compute.manager [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] [instance: e2e07720-a241-4382-a684-0835b199e37d] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  840.678136] env[65478]: DEBUG nova.virt.hardware [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  840.678728] env[65478]: DEBUG nova.virt.hardware [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  840.679249] env[65478]: DEBUG nova.virt.hardware [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  840.679553] env[65478]: DEBUG nova.virt.hardware [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  840.679901] env[65478]: DEBUG nova.virt.hardware [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  840.680587] env[65478]: DEBUG nova.virt.hardware [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  840.681084] env[65478]: DEBUG nova.virt.hardware [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  840.681431] env[65478]: DEBUG nova.virt.hardware [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  840.683687] env[65478]: DEBUG nova.virt.hardware [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  840.683687] env[65478]: DEBUG nova.virt.hardware [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  840.683687] env[65478]: DEBUG nova.virt.hardware [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  840.683687] env[65478]: DEBUG oslo_vmware.service [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a75e9518-e75b-4673-bdc3-5a63ffcd56d5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  840.702157] env[65478]: DEBUG oslo_vmware.service [None req-dd807451-82a4-463b-b40b-97dfb4420e3d tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-5457af34-bd83-4f25-a7d7-2b01fa764ae3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  840.738824] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011797, 'name': CreateVM_Task} progress is 25%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  840.758034] env[65478]: DEBUG nova.scheduler.client.report [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  840.783329] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  840.783535] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  840.940521] env[65478]: INFO nova.compute.manager [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] instance snapshotting
[  840.943670] env[65478]: DEBUG oslo_vmware.service [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-2f7a7531-e9c1-4d9f-9111-2f631f640abf {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  840.969404] env[65478]: DEBUG oslo_vmware.service [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-bb110643-f9ee-4bb0-bd5d-b85f7f63d741 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  841.024426] env[65478]: DEBUG oslo_concurrency.lockutils [None req-489780fd-2905-463a-a98b-f9dc14e61ec2 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Lock "98b2d40a-0c59-4540-b60e-17e5206dea42" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.912s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  841.178466] env[65478]: DEBUG oslo_concurrency.lockutils [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  841.247597] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011797, 'name': CreateVM_Task} progress is 25%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  841.264557] env[65478]: DEBUG oslo_concurrency.lockutils [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.658s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  841.265615] env[65478]: DEBUG nova.compute.manager [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] [instance: d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  841.271882] env[65478]: DEBUG oslo_concurrency.lockutils [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 14.759s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  841.271882] env[65478]: INFO nova.compute.claims [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 30e11bc9-0bfa-4cbf-bd02-f8262e343b79] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  841.294388] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  841.294872] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  841.295375] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  841.295634] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  841.295976] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  841.297634] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  841.297939] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[  841.299017] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  841.483762] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Creating Snapshot of the VM instance {{(pid=65478) _create_vm_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:913}}
[  841.483762] env[65478]: DEBUG oslo_vmware.service [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking VirtualMachine.CreateSnapshot_Task with opID=oslo.vmware-787468e2-eae7-421b-bc46-666f96978b7a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  841.498022] env[65478]: DEBUG oslo_vmware.api [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Waiting for the task: (returnval){
[  841.498022] env[65478]:    value = "task-6011799"
[  841.498022] env[65478]:    _type = "Task"
[  841.498022] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  841.507209] env[65478]: DEBUG oslo_vmware.api [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011799, 'name': CreateSnapshot_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  841.741225] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011797, 'name': CreateVM_Task, 'duration_secs': 1.17761} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  841.742456] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[  841.742456] env[65478]: WARNING neutronclient.v2_0.client [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  841.742456] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  841.743602] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  841.743679] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Acquired external semaphore "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[  841.744051] env[65478]: DEBUG oslo_vmware.service [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-d8817f63-99b8-4459-88b2-763f65264a2f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  841.754262] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Waiting for the task: (returnval){
[  841.754262] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]5292f013-e784-eeae-fe6a-61c7544974e6"
[  841.754262] env[65478]:    _type = "Task"
[  841.754262] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  841.774772] env[65478]: WARNING nova.utils [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] The MainProcess.default pool does not have free threads so the task <bound method ComputeManager._allocate_network_async of <nova.compute.manager.ComputeManager object at 0x73d94c2e6500>> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  841.781750] env[65478]: DEBUG nova.compute.utils [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  841.783807] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5292f013-e784-eeae-fe6a-61c7544974e6, 'name': SearchDatastore_Task, 'duration_secs': 0.010309} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  841.785647] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  841.785647] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[  841.785647] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  841.785647] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  841.786180] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Creating directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[  841.786180] env[65478]: DEBUG oslo_vmware.service [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-f79ae5c1-aac1-455f-a6d0-441d71d5f094 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  841.802686] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Created directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[  841.804177] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  841.804517] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Folder [datastore1] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[  841.805347] env[65478]: DEBUG oslo_vmware.service [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-0c49050d-f3c0-4540-854a-505b3f0c78c1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  841.812827] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Waiting for the task: (returnval){
[  841.812827] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52fe6999-4747-82c6-6a54-fe2ef6d20ab9"
[  841.812827] env[65478]:    _type = "Task"
[  841.812827] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  841.821869] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52fe6999-4747-82c6-6a54-fe2ef6d20ab9, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  841.824139] env[65478]: DEBUG nova.network.neutron [req-7689686a-7c9d-4de4-a2f6-d9642f7c1d3b req-6875185b-8c5a-4492-9b1f-582f106efed3 service nova] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Updated VIF entry in instance network info cache for port 2adf13cf-99c3-472f-bc02-769c66b01c29. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  841.824139] env[65478]: DEBUG nova.network.neutron [req-7689686a-7c9d-4de4-a2f6-d9642f7c1d3b req-6875185b-8c5a-4492-9b1f-582f106efed3 service nova] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Updating instance_info_cache with network_info: [{"id": "2adf13cf-99c3-472f-bc02-769c66b01c29", "address": "fa:16:3e:e2:31:b9", "network": {"id": "e14ef549-022b-4519-a212-c38b5cfbac29", "bridge": "br-int", "label": "tempest-ServersV294TestFqdnHostnames-244186933-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "10.180.180.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "d3e75bb33e1d4885a2a67dfd4c11409a", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "f9c4edd5-d88e-4996-afea-00130ace0dad", "external-id": "nsx-vlan-transportzone-261", "segmentation_id": 261, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap2adf13cf-99", "ovs_interfaceid": "2adf13cf-99c3-472f-bc02-769c66b01c29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  842.009248] env[65478]: DEBUG oslo_vmware.api [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011799, 'name': CreateSnapshot_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  842.151747] env[65478]: DEBUG oslo_concurrency.lockutils [None req-d70311ab-860c-4cfb-ae25-ef90db886c8b tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Acquiring lock "28200981-9217-4395-b0a8-c154624c7a1c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  842.152445] env[65478]: DEBUG oslo_concurrency.lockutils [None req-d70311ab-860c-4cfb-ae25-ef90db886c8b tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Lock "28200981-9217-4395-b0a8-c154624c7a1c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  842.286066] env[65478]: DEBUG nova.compute.manager [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] [instance: d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  842.337883] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52fe6999-4747-82c6-6a54-fe2ef6d20ab9, 'name': SearchDatastore_Task, 'duration_secs': 0.008975} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  842.340251] env[65478]: DEBUG oslo_concurrency.lockutils [req-7689686a-7c9d-4de4-a2f6-d9642f7c1d3b req-6875185b-8c5a-4492-9b1f-582f106efed3 service nova] Releasing lock "refresh_cache-fbf21f21-d370-4a6a-ae24-0e6840464e24" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  842.341834] env[65478]: DEBUG oslo_vmware.service [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-2eaff8dc-16f8-4fd0-9d1a-229b22d21060 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  842.352576] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Waiting for the task: (returnval){
[  842.352576] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52cb7055-aaf2-1931-d7d9-00518fdfc369"
[  842.352576] env[65478]:    _type = "Task"
[  842.352576] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  842.375201] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52cb7055-aaf2-1931-d7d9-00518fdfc369, 'name': SearchDatastore_Task, 'duration_secs': 0.010204} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  842.375374] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  842.375573] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Copying Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] ef569806-5f50-44b9-a4a9-0107328a8dfe/ef569806-5f50-44b9-a4a9-0107328a8dfe.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[  842.375874] env[65478]: DEBUG oslo_vmware.service [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-8042f6ff-7135-4ae3-b645-0ef5357563d5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  842.385512] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Waiting for the task: (returnval){
[  842.385512] env[65478]:    value = "task-6011800"
[  842.385512] env[65478]:    _type = "Task"
[  842.385512] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  842.403518] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011800, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  842.512505] env[65478]: DEBUG oslo_vmware.api [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011799, 'name': CreateSnapshot_Task, 'duration_secs': 0.744298} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  842.515042] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Created Snapshot of the VM instance {{(pid=65478) _create_vm_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:922}}
[  842.515042] env[65478]: DEBUG oslo_vmware.service [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-43ac443d-7fd1-441b-bf3f-996110ea700b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  842.657575] env[65478]: DEBUG nova.compute.utils [None req-d70311ab-860c-4cfb-ae25-ef90db886c8b tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  842.826409] env[65478]: DEBUG oslo_vmware.service [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0bd63d49-34c1-4b1b-b3a2-c566321eaafa {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  842.840170] env[65478]: DEBUG oslo_vmware.service [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-bc2fcc21-2d4f-4db8-8b68-468c970aa889 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  842.878345] env[65478]: DEBUG oslo_vmware.service [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4d21c42c-63bd-4d6c-ae3f-58363c737629 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  842.887565] env[65478]: DEBUG oslo_vmware.service [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-2d8b569c-e69e-49df-84e6-8658e188a8c3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  842.900228] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011800, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.497355} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  842.900540] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Copied Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] ef569806-5f50-44b9-a4a9-0107328a8dfe/ef569806-5f50-44b9-a4a9-0107328a8dfe.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[  842.901202] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[  842.901471] env[65478]: DEBUG oslo_vmware.service [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-1aad739c-3df0-47fb-ab16-676e13c12181 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  842.915504] env[65478]: DEBUG nova.compute.provider_tree [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  842.920956] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Waiting for the task: (returnval){
[  842.920956] env[65478]:    value = "task-6011801"
[  842.920956] env[65478]:    _type = "Task"
[  842.920956] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  842.949527] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011801, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  843.035787] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Creating linked-clone VM from snapshot {{(pid=65478) _create_linked_clone_from_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:955}}
[  843.036753] env[65478]: DEBUG oslo_vmware.service [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking VirtualMachine.CloneVM_Task with opID=oslo.vmware-be0eb7b5-b03e-4fee-807f-17fc1be2d3b9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  843.047112] env[65478]: DEBUG oslo_vmware.api [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Waiting for the task: (returnval){
[  843.047112] env[65478]:    value = "task-6011802"
[  843.047112] env[65478]:    _type = "Task"
[  843.047112] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  843.057496] env[65478]: DEBUG oslo_vmware.api [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011802, 'name': CloneVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  843.164931] env[65478]: DEBUG oslo_concurrency.lockutils [None req-d70311ab-860c-4cfb-ae25-ef90db886c8b tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Lock "28200981-9217-4395-b0a8-c154624c7a1c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.013s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  843.297503] env[65478]: DEBUG nova.compute.manager [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] [instance: d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  843.324313] env[65478]: DEBUG nova.virt.hardware [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  843.324525] env[65478]: DEBUG nova.virt.hardware [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  843.324652] env[65478]: DEBUG nova.virt.hardware [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  843.324785] env[65478]: DEBUG nova.virt.hardware [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  843.324888] env[65478]: DEBUG nova.virt.hardware [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  843.324993] env[65478]: DEBUG nova.virt.hardware [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  843.325181] env[65478]: DEBUG nova.virt.hardware [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  843.325320] env[65478]: DEBUG nova.virt.hardware [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  843.325447] env[65478]: DEBUG nova.virt.hardware [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  843.325570] env[65478]: DEBUG nova.virt.hardware [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  843.325716] env[65478]: DEBUG nova.virt.hardware [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  843.326783] env[65478]: DEBUG oslo_vmware.service [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d716e42a-f414-4b61-8765-c33f739052e2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  843.336236] env[65478]: DEBUG oslo_vmware.service [None req-50c671f2-984c-4ade-a769-9dfdcad18c06 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-7876de8a-28f5-4df8-a2fa-e1f643541c22 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  843.412741] env[65478]: DEBUG nova.compute.manager [req-c1355877-ff3f-4cbc-ab17-394181654961 req-a9e9cd75-474a-4e07-9be8-4cacc0e91a5d service nova] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Received event network-changed-d0ba0aff-4125-4028-bb87-c0e783d1e066 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  843.412924] env[65478]: DEBUG nova.compute.manager [req-c1355877-ff3f-4cbc-ab17-394181654961 req-a9e9cd75-474a-4e07-9be8-4cacc0e91a5d service nova] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Refreshing instance network info cache due to event network-changed-d0ba0aff-4125-4028-bb87-c0e783d1e066. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  843.413099] env[65478]: DEBUG oslo_concurrency.lockutils [req-c1355877-ff3f-4cbc-ab17-394181654961 req-a9e9cd75-474a-4e07-9be8-4cacc0e91a5d service nova] Acquiring lock "refresh_cache-ef569806-5f50-44b9-a4a9-0107328a8dfe" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  843.413206] env[65478]: DEBUG oslo_concurrency.lockutils [req-c1355877-ff3f-4cbc-ab17-394181654961 req-a9e9cd75-474a-4e07-9be8-4cacc0e91a5d service nova] Acquired lock "refresh_cache-ef569806-5f50-44b9-a4a9-0107328a8dfe" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  843.413327] env[65478]: DEBUG nova.network.neutron [req-c1355877-ff3f-4cbc-ab17-394181654961 req-a9e9cd75-474a-4e07-9be8-4cacc0e91a5d service nova] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Refreshing network info cache for port d0ba0aff-4125-4028-bb87-c0e783d1e066 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  843.420036] env[65478]: DEBUG nova.scheduler.client.report [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  843.433495] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011801, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.074789} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  843.433800] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[  843.434740] env[65478]: DEBUG oslo_vmware.service [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e848741e-e331-4b65-8f3d-85ab7a621be6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  843.464333] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Reconfiguring VM instance instance-00000021 to attach disk [datastore1] ef569806-5f50-44b9-a4a9-0107328a8dfe/ef569806-5f50-44b9-a4a9-0107328a8dfe.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  843.464937] env[65478]: DEBUG oslo_vmware.service [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-e1cbbf59-49b7-45f3-b4b2-bc0ef1f7ee3c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  843.489942] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Waiting for the task: (returnval){
[  843.489942] env[65478]:    value = "task-6011803"
[  843.489942] env[65478]:    _type = "Task"
[  843.489942] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  843.500843] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011803, 'name': ReconfigVM_Task} progress is 5%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  843.559843] env[65478]: DEBUG oslo_vmware.api [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011802, 'name': CloneVM_Task} progress is 94%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  843.915957] env[65478]: WARNING neutronclient.v2_0.client [req-c1355877-ff3f-4cbc-ab17-394181654961 req-a9e9cd75-474a-4e07-9be8-4cacc0e91a5d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  843.926178] env[65478]: DEBUG oslo_concurrency.lockutils [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.656s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  843.927833] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 16.837s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  843.929659] env[65478]: INFO nova.compute.claims [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] [instance: 00b6d30d-5de3-4c87-8af4-0fe6d88eb906] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  843.932550] env[65478]: DEBUG nova.compute.manager [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 30e11bc9-0bfa-4cbf-bd02-f8262e343b79] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  844.004029] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011803, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  844.067159] env[65478]: DEBUG oslo_vmware.api [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011802, 'name': CloneVM_Task} progress is 94%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  844.244963] env[65478]: DEBUG oslo_concurrency.lockutils [None req-d70311ab-860c-4cfb-ae25-ef90db886c8b tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Acquiring lock "28200981-9217-4395-b0a8-c154624c7a1c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  844.245112] env[65478]: DEBUG oslo_concurrency.lockutils [None req-d70311ab-860c-4cfb-ae25-ef90db886c8b tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Lock "28200981-9217-4395-b0a8-c154624c7a1c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  844.245237] env[65478]: INFO nova.compute.manager [None req-d70311ab-860c-4cfb-ae25-ef90db886c8b tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Attaching volume 184b333f-06cf-43b1-b4cc-ef9df913627b to /dev/sdb
[  844.308278] env[65478]: DEBUG oslo_vmware.service [None req-d70311ab-860c-4cfb-ae25-ef90db886c8b tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f8d3b706-bd8d-4a25-993f-a16162bd4cfe {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  844.318678] env[65478]: DEBUG oslo_vmware.service [None req-d70311ab-860c-4cfb-ae25-ef90db886c8b tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-27c8b9d2-e6a5-41a9-b16d-bcc8af13392c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  844.336255] env[65478]: DEBUG nova.virt.block_device [None req-d70311ab-860c-4cfb-ae25-ef90db886c8b tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Updating existing volume attachment record: 7cb7c418-87a2-4ef9-805d-08e4d4a49342 {{(pid=65478) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
[  844.379640] env[65478]: WARNING neutronclient.v2_0.client [req-c1355877-ff3f-4cbc-ab17-394181654961 req-a9e9cd75-474a-4e07-9be8-4cacc0e91a5d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  844.439129] env[65478]: WARNING nova.utils [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] The MainProcess.default pool does not have free threads so the task <bound method ComputeManager._allocate_network_async of <nova.compute.manager.ComputeManager object at 0x73d94c2e6500>> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  844.449421] env[65478]: DEBUG nova.compute.utils [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  844.507617] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011803, 'name': ReconfigVM_Task, 'duration_secs': 0.594515} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  844.508294] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Reconfigured VM instance instance-00000021 to attach disk [datastore1] ef569806-5f50-44b9-a4a9-0107328a8dfe/ef569806-5f50-44b9-a4a9-0107328a8dfe.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  844.508689] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Creating Virtual Disk of size  1048576 KB and adapter type paraVirtual on the data store {{(pid=65478) create_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1383}}
[  844.509701] env[65478]: DEBUG oslo_vmware.service [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking VirtualDiskManager.CreateVirtualDisk_Task with opID=oslo.vmware-9477720b-6d0e-4481-af82-ac61dcac118c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  844.519314] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Waiting for the task: (returnval){
[  844.519314] env[65478]:    value = "task-6011804"
[  844.519314] env[65478]:    _type = "Task"
[  844.519314] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  844.532702] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011804, 'name': CreateVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  844.563874] env[65478]: DEBUG oslo_vmware.api [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011802, 'name': CloneVM_Task} progress is 100%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  844.566255] env[65478]: DEBUG nova.network.neutron [req-c1355877-ff3f-4cbc-ab17-394181654961 req-a9e9cd75-474a-4e07-9be8-4cacc0e91a5d service nova] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Updated VIF entry in instance network info cache for port d0ba0aff-4125-4028-bb87-c0e783d1e066. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  844.566994] env[65478]: DEBUG nova.network.neutron [req-c1355877-ff3f-4cbc-ab17-394181654961 req-a9e9cd75-474a-4e07-9be8-4cacc0e91a5d service nova] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Updating instance_info_cache with network_info: [{"id": "d0ba0aff-4125-4028-bb87-c0e783d1e066", "address": "fa:16:3e:03:25:35", "network": {"id": "2ed010d6-4573-4056-a189-22d86fca4369", "bridge": "br-int", "label": "tempest-ServersWithSpecificFlavorTestJSON-2103777099-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "70efc035843c47d69ec6a42f446a2b91", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "b250e561-3be3-4bae-be1a-162251b1ee31", "external-id": "nsx-vlan-transportzone-464", "segmentation_id": 464, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapd0ba0aff-41", "ovs_interfaceid": "d0ba0aff-4125-4028-bb87-c0e783d1e066", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  844.928968] env[65478]: WARNING nova.utils [None req-82817aff-398b-4360-bcdd-f1c58562eb71 tempest-SecurityGroupsTestJSON-1593388229 tempest-SecurityGroupsTestJSON-1593388229-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d9205edd80> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  844.952241] env[65478]: DEBUG nova.compute.manager [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 30e11bc9-0bfa-4cbf-bd02-f8262e343b79] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  845.039299] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011804, 'name': CreateVirtualDisk_Task, 'duration_secs': 0.094534} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  845.041648] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Created Virtual Disk of size 1048576 KB and type thin {{(pid=65478) create_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1404}}
[  845.043054] env[65478]: DEBUG oslo_vmware.service [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-66ba93a6-c1bf-44dc-9171-6705271827ce {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  845.069327] env[65478]: DEBUG oslo_vmware.api [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011802, 'name': CloneVM_Task, 'duration_secs': 1.575607} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  845.090383] env[65478]: DEBUG oslo_concurrency.lockutils [req-c1355877-ff3f-4cbc-ab17-394181654961 req-a9e9cd75-474a-4e07-9be8-4cacc0e91a5d service nova] Releasing lock "refresh_cache-ef569806-5f50-44b9-a4a9-0107328a8dfe" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  845.094852] env[65478]: INFO nova.virt.vmwareapi.vmops [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Created linked-clone VM from snapshot
[  845.094852] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Reconfiguring VM instance instance-00000021 to attach disk [datastore1] ef569806-5f50-44b9-a4a9-0107328a8dfe/ephemeral_0.vmdk or device None with type thin {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  845.095469] env[65478]: DEBUG oslo_vmware.service [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-f8ee63dd-fb61-4c46-ba77-a3d8eee276bf {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  845.100242] env[65478]: DEBUG oslo_vmware.service [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-11e19869-f020-4592-9a96-95481b67cfb6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  845.125832] env[65478]: DEBUG nova.virt.vmwareapi.images [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Uploading image 5d1ee82c-c0b5-44a0-b784-11f74451c1fd {{(pid=65478) upload_image_stream_optimized /opt/stack/nova/nova/virt/vmwareapi/images.py:441}}
[  845.135996] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Waiting for the task: (returnval){
[  845.135996] env[65478]:    value = "task-6011808"
[  845.135996] env[65478]:    _type = "Task"
[  845.135996] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  845.156206] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011808, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  845.210154] env[65478]: DEBUG oslo_vmware.rw_handles [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Creating HttpNfcLease lease for exporting VM: (result){
[  845.210154] env[65478]:    value = "vm-1161291"
[  845.210154] env[65478]:    _type = "VirtualMachine"
[  845.210154] env[65478]:  }. {{(pid=65478) _create_export_vm_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:478}}
[  845.210154] env[65478]: DEBUG oslo_vmware.service [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking VirtualMachine.ExportVm with opID=oslo.vmware-84a2b3f1-df15-43b6-b6e9-9f5f4f5e8a28 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  845.225122] env[65478]: DEBUG oslo_vmware.rw_handles [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Lease: (returnval){
[  845.225122] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c291c6-bd79-2aff-ed45-0b709d60f34f"
[  845.225122] env[65478]:    _type = "HttpNfcLease"
[  845.225122] env[65478]:  } obtained for exporting VM: (result){
[  845.225122] env[65478]:    value = "vm-1161291"
[  845.225122] env[65478]:    _type = "VirtualMachine"
[  845.225122] env[65478]:  }. {{(pid=65478) _create_export_vm_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:481}}
[  845.225122] env[65478]: DEBUG oslo_vmware.api [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Waiting for the lease: (returnval){
[  845.225122] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c291c6-bd79-2aff-ed45-0b709d60f34f"
[  845.225122] env[65478]:    _type = "HttpNfcLease"
[  845.225122] env[65478]:  } to be ready. {{(pid=65478) wait_for_lease_ready /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:462}}
[  845.241285] env[65478]: DEBUG oslo_vmware.api [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Lease: (returnval){
[  845.241285] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c291c6-bd79-2aff-ed45-0b709d60f34f"
[  845.241285] env[65478]:    _type = "HttpNfcLease"
[  845.241285] env[65478]:  } is ready. {{(pid=65478) _poll_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:487}}
[  845.241285] env[65478]: DEBUG oslo_vmware.rw_handles [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking VIM API for reading info of lease: (returnval){
[  845.241285] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c291c6-bd79-2aff-ed45-0b709d60f34f"
[  845.241285] env[65478]:    _type = "HttpNfcLease"
[  845.241285] env[65478]:  }. {{(pid=65478) _create_export_vm_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:486}}
[  845.241285] env[65478]: DEBUG oslo_vmware.service [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f0d70d51-6691-46ed-8160-c78bf7f0d8c4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  845.256696] env[65478]: DEBUG oslo_vmware.rw_handles [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Found VMDK URL: https://esx7c1n1.openstack.eu-de-1.cloud.sap/nfc/52ecaf25-bea9-d2d8-f1c9-dec486a0cb11/disk-0.vmdk from lease info. {{(pid=65478) _find_vmdk_url /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:531}}
[  845.257187] env[65478]: DEBUG oslo_vmware.rw_handles [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Opening URL: https://esx7c1n1.openstack.eu-de-1.cloud.sap/nfc/52ecaf25-bea9-d2d8-f1c9-dec486a0cb11/disk-0.vmdk for reading. {{(pid=65478) _create_read_connection /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:99}}
[  845.329783] env[65478]: WARNING nova.utils [None req-83d06c08-0fa1-4f7d-95c2-860f8b002647 tempest-ServerMetadataNegativeTestJSON-470884849 tempest-ServerMetadataNegativeTestJSON-470884849-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d9384b8790> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  845.375433] env[65478]: DEBUG oslo_vmware.service [-] Invoking HttpNfcLease.HttpNfcLeaseProgress with opID=oslo.vmware-697d1b45-dad4-4848-9d98-f7194aa6148f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  845.385545] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'oslo_vmware.rw_handles.VmdkHandle.update_progress' sleeping for 59.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[  845.646654] env[65478]: DEBUG nova.compute.manager [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  845.647797] env[65478]: DEBUG oslo_vmware.service [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-25fc4596-23bd-4be8-b049-59f021ef58b8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  845.662812] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011808, 'name': ReconfigVM_Task, 'duration_secs': 0.40816} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  845.663234] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Reconfigured VM instance instance-00000021 to attach disk [datastore1] ef569806-5f50-44b9-a4a9-0107328a8dfe/ephemeral_0.vmdk or device None with type thin {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  845.664243] env[65478]: DEBUG oslo_vmware.service [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-8695d8cc-1c91-4eeb-9a52-fe5017a9238a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  845.680851] env[65478]: DEBUG oslo_vmware.service [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b59174c8-c571-46ea-bd6a-2dbd0eb8ecae {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  845.680944] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Waiting for the task: (returnval){
[  845.680944] env[65478]:    value = "task-6011810"
[  845.680944] env[65478]:    _type = "Task"
[  845.680944] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  845.697847] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011810, 'name': Rename_Task} progress is 5%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  845.699548] env[65478]: DEBUG oslo_vmware.service [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0fa267a7-5a70-4293-8623-fac02f5aaca7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  845.752857] env[65478]: DEBUG oslo_vmware.service [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a75a1ff4-0515-4acc-84dc-4d6f70a4cc78 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  845.767139] env[65478]: DEBUG oslo_vmware.service [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e932dd98-35ce-43e3-a410-20031de010ce {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  845.798886] env[65478]: DEBUG nova.compute.provider_tree [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  845.967763] env[65478]: DEBUG nova.compute.manager [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] [instance: 30e11bc9-0bfa-4cbf-bd02-f8262e343b79] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  846.007448] env[65478]: DEBUG nova.virt.hardware [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  846.008520] env[65478]: DEBUG nova.virt.hardware [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  846.009320] env[65478]: DEBUG nova.virt.hardware [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  846.010886] env[65478]: DEBUG nova.virt.hardware [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  846.011069] env[65478]: DEBUG nova.virt.hardware [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  846.011240] env[65478]: DEBUG nova.virt.hardware [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  846.011634] env[65478]: DEBUG nova.virt.hardware [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  846.011903] env[65478]: DEBUG nova.virt.hardware [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  846.012037] env[65478]: DEBUG nova.virt.hardware [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  846.012200] env[65478]: DEBUG nova.virt.hardware [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  846.012337] env[65478]: DEBUG nova.virt.hardware [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  846.013639] env[65478]: DEBUG oslo_vmware.service [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-7a7684b6-616f-4389-b90d-bbf89966fa03 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  846.028081] env[65478]: DEBUG oslo_vmware.service [None req-96ce0c97-30ad-429f-83ec-0ef8a1718f21 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-2bbdba4e-2cf7-4336-95d1-63af460f99fa {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  846.174549] env[65478]: INFO nova.compute.manager [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] instance snapshotting
[  846.176634] env[65478]: DEBUG nova.objects.instance [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lazy-loading 'flavor' on Instance uuid 9b286a00-af27-4012-a596-45bbe98da254 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  846.204489] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011810, 'name': Rename_Task, 'duration_secs': 0.292602} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  846.204705] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  846.205165] env[65478]: DEBUG oslo_vmware.service [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-4132e98f-ab34-46a8-90ef-9ff6d58b3a97 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  846.214080] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Waiting for the task: (returnval){
[  846.214080] env[65478]:    value = "task-6011811"
[  846.214080] env[65478]:    _type = "Task"
[  846.214080] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  846.231387] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011811, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  846.302564] env[65478]: DEBUG nova.scheduler.client.report [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  846.497872] env[65478]: WARNING nova.utils [None req-a44f7175-d697-45ed-b855-f5d470e4f064 tempest-ServerActionsV293TestJSON-1885426227 tempest-ServerActionsV293TestJSON-1885426227-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d9384b9bd0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  846.686423] env[65478]: DEBUG oslo_vmware.service [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-bab7a379-49d6-4e59-972b-159398d44b31 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  846.708891] env[65478]: DEBUG oslo_vmware.service [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-65ade9b1-e03c-4b3e-882d-275d82104115 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  846.730298] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011811, 'name': PowerOnVM_Task} progress is 88%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  846.744569] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2551781a-2548-4978-bbd2-771fab898472 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Acquiring lock "98b2d40a-0c59-4540-b60e-17e5206dea42" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  846.744569] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2551781a-2548-4978-bbd2-771fab898472 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Lock "98b2d40a-0c59-4540-b60e-17e5206dea42" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  846.809112] env[65478]: DEBUG oslo_concurrency.lockutils [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.883s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  846.809687] env[65478]: DEBUG nova.compute.manager [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] [instance: 00b6d30d-5de3-4c87-8af4-0fe6d88eb906] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  846.816134] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 19.310s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  846.817669] env[65478]: DEBUG nova.objects.instance [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Lazy-loading 'resources' on Instance uuid 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  847.226264] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Creating Snapshot of the VM instance {{(pid=65478) _create_vm_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:913}}
[  847.227986] env[65478]: DEBUG oslo_vmware.service [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualMachine.CreateSnapshot_Task with opID=oslo.vmware-7a61737e-34ea-45b4-adf5-fd39b8166359 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  847.235356] env[65478]: DEBUG oslo_vmware.api [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011811, 'name': PowerOnVM_Task, 'duration_secs': 0.687872} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  847.235691] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  847.235906] env[65478]: INFO nova.compute.manager [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Took 15.55 seconds to spawn the instance on the hypervisor.
[  847.236180] env[65478]: DEBUG nova.compute.manager [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  847.237048] env[65478]: DEBUG oslo_vmware.service [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-164dcae3-2563-4109-9f40-84a6a9d04469 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  847.242917] env[65478]: DEBUG oslo_vmware.api [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  847.242917] env[65478]:    value = "task-6011813"
[  847.242917] env[65478]:    _type = "Task"
[  847.242917] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  847.249564] env[65478]: INFO nova.compute.manager [None req-2551781a-2548-4978-bbd2-771fab898472 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Detaching volume 40f82a17-27d1-4c63-987b-11d774c1afea
[  847.260797] env[65478]: DEBUG oslo_vmware.api [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011813, 'name': CreateSnapshot_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  847.310663] env[65478]: INFO nova.virt.block_device [None req-2551781a-2548-4978-bbd2-771fab898472 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Attempting to driver detach volume 40f82a17-27d1-4c63-987b-11d774c1afea from mountpoint /dev/sdb
[  847.310947] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-2551781a-2548-4978-bbd2-771fab898472 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Volume detach. Driver type: vmdk {{(pid=65478) detach_volume /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:646}}
[  847.311151] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-2551781a-2548-4978-bbd2-771fab898472 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] _detach_volume_vmdk: {'driver_volume_type': 'vmdk', 'data': {'volume': 'vm-1161287', 'volume_id': '40f82a17-27d1-4c63-987b-11d774c1afea', 'name': 'volume-40f82a17-27d1-4c63-987b-11d774c1afea', 'profile_id': None, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'physical_block_size': '512', 'logical_block_size': '512', 'enforce_multipath': False}, 'status': 'reserved', 'instance': '98b2d40a-0c59-4540-b60e-17e5206dea42', 'attached_at': '', 'detached_at': '', 'volume_id': '40f82a17-27d1-4c63-987b-11d774c1afea', 'serial': '40f82a17-27d1-4c63-987b-11d774c1afea'} {{(pid=65478) _detach_volume_vmdk /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:571}}
[  847.314089] env[65478]: DEBUG oslo_vmware.service [None req-2551781a-2548-4978-bbd2-771fab898472 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d44ea1fe-31df-4574-be13-3aee177c9fc4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  847.329597] env[65478]: WARNING nova.utils [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] The MainProcess.default pool does not have free threads so the task <bound method ComputeManager._allocate_network_async of <nova.compute.manager.ComputeManager object at 0x73d94c2e6500>> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  847.335255] env[65478]: DEBUG nova.compute.utils [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  847.360365] env[65478]: DEBUG oslo_vmware.service [None req-2551781a-2548-4978-bbd2-771fab898472 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e47d430f-9697-4a18-921e-1fc8637ab91d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  847.374751] env[65478]: DEBUG oslo_vmware.service [None req-2551781a-2548-4978-bbd2-771fab898472 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-48d180ed-92d4-4904-ace4-9293ce791b62 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  847.412140] env[65478]: DEBUG oslo_vmware.service [None req-2551781a-2548-4978-bbd2-771fab898472 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-25c8b5ed-3d44-4b6b-89ae-b97dd1c49473 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  847.438249] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-2551781a-2548-4978-bbd2-771fab898472 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] The volume has not been displaced from its original location: [datastore1] volume-40f82a17-27d1-4c63-987b-11d774c1afea/volume-40f82a17-27d1-4c63-987b-11d774c1afea.vmdk. No consolidation needed. {{(pid=65478) _consolidate_vmdk_volume /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:504}}
[  847.444202] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-2551781a-2548-4978-bbd2-771fab898472 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Reconfiguring VM instance instance-0000000a to detach disk 2001 {{(pid=65478) detach_disk_from_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:122}}
[  847.444580] env[65478]: DEBUG oslo_vmware.service [None req-2551781a-2548-4978-bbd2-771fab898472 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-78811f91-38b3-474a-a9f2-6689ad793297 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  847.471931] env[65478]: DEBUG oslo_vmware.api [None req-2551781a-2548-4978-bbd2-771fab898472 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Waiting for the task: (returnval){
[  847.471931] env[65478]:    value = "task-6011814"
[  847.471931] env[65478]:    _type = "Task"
[  847.471931] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  847.494449] env[65478]: DEBUG oslo_vmware.api [None req-2551781a-2548-4978-bbd2-771fab898472 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Task: {'id': task-6011814, 'name': ReconfigVM_Task} progress is 10%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  847.754552] env[65478]: DEBUG oslo_vmware.api [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011813, 'name': CreateSnapshot_Task} progress is 100%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  847.779290] env[65478]: INFO nova.compute.manager [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Took 31.90 seconds to build instance.
[  847.861590] env[65478]: DEBUG nova.compute.manager [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] [instance: 00b6d30d-5de3-4c87-8af4-0fe6d88eb906] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  847.985706] env[65478]: DEBUG oslo_vmware.api [None req-2551781a-2548-4978-bbd2-771fab898472 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Task: {'id': task-6011814, 'name': ReconfigVM_Task, 'duration_secs': 0.258328} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  847.986431] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-2551781a-2548-4978-bbd2-771fab898472 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Reconfigured VM instance instance-0000000a to detach disk 2001 {{(pid=65478) detach_disk_from_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:127}}
[  847.991979] env[65478]: DEBUG oslo_vmware.service [None req-2551781a-2548-4978-bbd2-771fab898472 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-5ce45015-5e5e-45c3-8939-ef6867655906 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  847.998917] env[65478]: DEBUG oslo_vmware.service [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ebd8f803-e36f-4f83-b5e6-2895d1cbf894 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  848.013798] env[65478]: DEBUG oslo_vmware.service [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-cb7f4ab1-ca71-4fde-8d9d-d3a305528836 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  848.019138] env[65478]: DEBUG oslo_vmware.api [None req-2551781a-2548-4978-bbd2-771fab898472 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Waiting for the task: (returnval){
[  848.019138] env[65478]:    value = "task-6011815"
[  848.019138] env[65478]:    _type = "Task"
[  848.019138] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  848.048149] env[65478]: DEBUG oslo_vmware.api [None req-2551781a-2548-4978-bbd2-771fab898472 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Task: {'id': task-6011815, 'name': ReconfigVM_Task} progress is 10%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  848.057514] env[65478]: DEBUG oslo_vmware.service [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-5c7e316c-a786-4925-af66-8df2b2187c80 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  848.068638] env[65478]: DEBUG oslo_vmware.service [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4daad8a8-0682-4c64-ab86-8a39a1d92dad {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  848.087813] env[65478]: DEBUG nova.compute.provider_tree [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  848.254594] env[65478]: DEBUG oslo_vmware.api [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011813, 'name': CreateSnapshot_Task, 'duration_secs': 0.539454} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  848.254867] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Created Snapshot of the VM instance {{(pid=65478) _create_vm_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:922}}
[  848.255653] env[65478]: DEBUG oslo_vmware.service [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f8403a26-be3b-47f1-a786-b695839e0375 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  848.287515] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a069c44c-800a-47cd-a4ca-6f5b3ba3f9eb tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Lock "ef569806-5f50-44b9-a4a9-0107328a8dfe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.416s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  848.287747] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Acquiring lock "28d4751c-5d09-422a-84b1-e82df32f6b4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  848.287955] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Lock "28d4751c-5d09-422a-84b1-e82df32f6b4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  848.530379] env[65478]: DEBUG oslo_vmware.api [None req-2551781a-2548-4978-bbd2-771fab898472 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Task: {'id': task-6011815, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  848.590963] env[65478]: DEBUG nova.scheduler.client.report [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  848.778558] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Creating linked-clone VM from snapshot {{(pid=65478) _create_linked_clone_from_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:955}}
[  848.779611] env[65478]: DEBUG oslo_vmware.service [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualMachine.CloneVM_Task with opID=oslo.vmware-4f06ce2a-5aa5-4035-9966-f9d16636a6ea {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  848.792101] env[65478]: DEBUG oslo_vmware.api [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  848.792101] env[65478]:    value = "task-6011816"
[  848.792101] env[65478]:    _type = "Task"
[  848.792101] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  848.797234] env[65478]: DEBUG nova.compute.manager [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] [instance: 28d4751c-5d09-422a-84b1-e82df32f6b4d] Starting instance... {{(pid=65478) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}}
[  848.805266] env[65478]: DEBUG oslo_vmware.api [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011816, 'name': CloneVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  848.871602] env[65478]: DEBUG nova.compute.manager [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] [instance: 00b6d30d-5de3-4c87-8af4-0fe6d88eb906] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  848.909057] env[65478]: DEBUG nova.virt.hardware [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  848.909307] env[65478]: DEBUG nova.virt.hardware [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  848.909450] env[65478]: DEBUG nova.virt.hardware [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  848.909628] env[65478]: DEBUG nova.virt.hardware [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  848.909752] env[65478]: DEBUG nova.virt.hardware [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  848.909861] env[65478]: DEBUG nova.virt.hardware [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  848.910047] env[65478]: DEBUG nova.virt.hardware [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  848.910253] env[65478]: DEBUG nova.virt.hardware [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  848.910396] env[65478]: DEBUG nova.virt.hardware [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  848.910524] env[65478]: DEBUG nova.virt.hardware [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  848.910794] env[65478]: DEBUG nova.virt.hardware [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  848.911848] env[65478]: DEBUG oslo_vmware.service [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1e7f498a-b68c-4da3-a71c-673b48024ed4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  848.921421] env[65478]: DEBUG oslo_vmware.service [None req-dc9d993e-9042-42e6-bd06-175031859510 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-70d7d408-3c3c-4c7b-828c-1f73ddc0c47b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  849.036730] env[65478]: DEBUG oslo_vmware.api [None req-2551781a-2548-4978-bbd2-771fab898472 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Task: {'id': task-6011815, 'name': ReconfigVM_Task, 'duration_secs': 0.858018} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  849.039396] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-2551781a-2548-4978-bbd2-771fab898472 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Detached VMDK: {'driver_volume_type': 'vmdk', 'data': {'volume': 'vm-1161287', 'volume_id': '40f82a17-27d1-4c63-987b-11d774c1afea', 'name': 'volume-40f82a17-27d1-4c63-987b-11d774c1afea', 'profile_id': None, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'physical_block_size': '512', 'logical_block_size': '512', 'enforce_multipath': False}, 'status': 'reserved', 'instance': '98b2d40a-0c59-4540-b60e-17e5206dea42', 'attached_at': '', 'detached_at': '', 'volume_id': '40f82a17-27d1-4c63-987b-11d774c1afea', 'serial': '40f82a17-27d1-4c63-987b-11d774c1afea'} {{(pid=65478) _detach_volume_vmdk /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:605}}
[  849.097856] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.280s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  849.098061] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 20.472s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  849.144914] env[65478]: INFO nova.scheduler.client.report [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Deleted allocations for instance 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3
[  849.308653] env[65478]: DEBUG oslo_vmware.api [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011816, 'name': CloneVM_Task} progress is 94%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  849.339771] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  849.409192] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-d70311ab-860c-4cfb-ae25-ef90db886c8b tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Volume attach. Driver type: vmdk {{(pid=65478) attach_volume /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:439}}
[  849.409433] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-d70311ab-860c-4cfb-ae25-ef90db886c8b tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] _attach_volume_vmdk: {'driver_volume_type': 'vmdk', 'data': {'volume': 'vm-1161293', 'volume_id': '184b333f-06cf-43b1-b4cc-ef9df913627b', 'name': 'volume-184b333f-06cf-43b1-b4cc-ef9df913627b', 'profile_id': None, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'physical_block_size': '512', 'logical_block_size': '512', 'enforce_multipath': False}, 'status': 'reserved', 'instance': '28200981-9217-4395-b0a8-c154624c7a1c', 'attached_at': '', 'detached_at': '', 'volume_id': '184b333f-06cf-43b1-b4cc-ef9df913627b', 'serial': '184b333f-06cf-43b1-b4cc-ef9df913627b'} {{(pid=65478) _attach_volume_vmdk /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:336}}
[  849.410513] env[65478]: DEBUG oslo_vmware.service [None req-d70311ab-860c-4cfb-ae25-ef90db886c8b tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-37c64d7d-4860-4d72-9ef6-398c08b5da4e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  849.432275] env[65478]: DEBUG oslo_vmware.service [None req-d70311ab-860c-4cfb-ae25-ef90db886c8b tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f6ecb640-4c99-46cc-80c7-de3310cab811 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  849.465059] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-d70311ab-860c-4cfb-ae25-ef90db886c8b tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Reconfiguring VM instance instance-00000020 to attach disk [datastore1] volume-184b333f-06cf-43b1-b4cc-ef9df913627b/volume-184b333f-06cf-43b1-b4cc-ef9df913627b.vmdk or device None with type thin {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  849.465364] env[65478]: DEBUG oslo_vmware.service [None req-d70311ab-860c-4cfb-ae25-ef90db886c8b tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-f34956bf-804d-4f35-aebc-0cd164f6ef83 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  849.489099] env[65478]: DEBUG oslo_vmware.api [None req-d70311ab-860c-4cfb-ae25-ef90db886c8b tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for the task: (returnval){
[  849.489099] env[65478]:    value = "task-6011817"
[  849.489099] env[65478]:    _type = "Task"
[  849.489099] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  849.502107] env[65478]: DEBUG oslo_vmware.api [None req-d70311ab-860c-4cfb-ae25-ef90db886c8b tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011817, 'name': ReconfigVM_Task} progress is 5%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  849.604360] env[65478]: INFO nova.compute.claims [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  849.655546] env[65478]: DEBUG oslo_concurrency.lockutils [None req-b88380fe-a9f4-4ae8-9915-1647747b63df tempest-ServersListShow296Test-314286983 tempest-ServersListShow296Test-314286983-project-member] Lock "4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 27.560s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  849.663170] env[65478]: DEBUG nova.objects.instance [None req-2551781a-2548-4978-bbd2-771fab898472 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Lazy-loading 'flavor' on Instance uuid 98b2d40a-0c59-4540-b60e-17e5206dea42 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  849.810142] env[65478]: DEBUG oslo_vmware.api [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011816, 'name': CloneVM_Task} progress is 94%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  850.003386] env[65478]: DEBUG oslo_vmware.api [None req-d70311ab-860c-4cfb-ae25-ef90db886c8b tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011817, 'name': ReconfigVM_Task, 'duration_secs': 0.411654} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  850.003724] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-d70311ab-860c-4cfb-ae25-ef90db886c8b tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Reconfigured VM instance instance-00000020 to attach disk [datastore1] volume-184b333f-06cf-43b1-b4cc-ef9df913627b/volume-184b333f-06cf-43b1-b4cc-ef9df913627b.vmdk or device None with type thin {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  850.009100] env[65478]: DEBUG oslo_vmware.service [None req-d70311ab-860c-4cfb-ae25-ef90db886c8b tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-a8024e2b-15f6-4d24-83f1-5ce1fc028714 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  850.028816] env[65478]: DEBUG oslo_vmware.api [None req-d70311ab-860c-4cfb-ae25-ef90db886c8b tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for the task: (returnval){
[  850.028816] env[65478]:    value = "task-6011818"
[  850.028816] env[65478]:    _type = "Task"
[  850.028816] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  850.042879] env[65478]: DEBUG oslo_vmware.api [None req-d70311ab-860c-4cfb-ae25-ef90db886c8b tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011818, 'name': ReconfigVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  850.113211] env[65478]: INFO nova.compute.resource_tracker [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Updating resource usage from migration f558a7ca-024a-4401-b9e1-cfa6bff8bb87
[  850.311897] env[65478]: DEBUG oslo_vmware.api [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011816, 'name': CloneVM_Task} progress is 94%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  850.543189] env[65478]: DEBUG oslo_vmware.api [None req-d70311ab-860c-4cfb-ae25-ef90db886c8b tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011818, 'name': ReconfigVM_Task, 'duration_secs': 0.160191} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  850.543481] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-d70311ab-860c-4cfb-ae25-ef90db886c8b tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Attached VMDK: {'driver_volume_type': 'vmdk', 'data': {'volume': 'vm-1161293', 'volume_id': '184b333f-06cf-43b1-b4cc-ef9df913627b', 'name': 'volume-184b333f-06cf-43b1-b4cc-ef9df913627b', 'profile_id': None, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'physical_block_size': '512', 'logical_block_size': '512', 'enforce_multipath': False}, 'status': 'reserved', 'instance': '28200981-9217-4395-b0a8-c154624c7a1c', 'attached_at': '', 'detached_at': '', 'volume_id': '184b333f-06cf-43b1-b4cc-ef9df913627b', 'serial': '184b333f-06cf-43b1-b4cc-ef9df913627b'} {{(pid=65478) _attach_volume_vmdk /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:361}}
[  850.673688] env[65478]: DEBUG oslo_concurrency.lockutils [None req-2551781a-2548-4978-bbd2-771fab898472 tempest-VolumesAssistedSnapshotsTest-638083671 tempest-VolumesAssistedSnapshotsTest-638083671-project-admin] Lock "98b2d40a-0c59-4540-b60e-17e5206dea42" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.930s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  850.765422] env[65478]: DEBUG oslo_vmware.service [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-2d3f0470-595f-4d0e-9d78-ca2974ff8e50 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  850.779651] env[65478]: DEBUG oslo_vmware.service [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ccd19861-0f35-4e41-a386-a39749f6043a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  850.825489] env[65478]: DEBUG oslo_vmware.api [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011816, 'name': CloneVM_Task} progress is 95%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  850.846022] env[65478]: DEBUG oslo_vmware.service [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9ace05ad-f00e-4978-b600-fb87515da7b4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  850.853200] env[65478]: DEBUG oslo_vmware.service [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-55b553d4-faea-4944-bec1-16cf6190db1e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  850.870106] env[65478]: DEBUG nova.compute.provider_tree [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  851.318085] env[65478]: DEBUG oslo_vmware.api [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011816, 'name': CloneVM_Task, 'duration_secs': 2.235169} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  851.318414] env[65478]: INFO nova.virt.vmwareapi.vmops [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Created linked-clone VM from snapshot
[  851.319953] env[65478]: DEBUG oslo_vmware.service [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1d29a633-1e04-4882-b6c8-46e39f3f3fc7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  851.333466] env[65478]: DEBUG nova.virt.vmwareapi.images [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Uploading image c9f40f18-b301-41ed-99ed-46614a14a522 {{(pid=65478) upload_image_stream_optimized /opt/stack/nova/nova/virt/vmwareapi/images.py:441}}
[  851.368561] env[65478]: DEBUG oslo_vmware.rw_handles [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Creating HttpNfcLease lease for exporting VM: (result){
[  851.368561] env[65478]:    value = "vm-1161295"
[  851.368561] env[65478]:    _type = "VirtualMachine"
[  851.368561] env[65478]:  }. {{(pid=65478) _create_export_vm_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:478}}
[  851.368561] env[65478]: DEBUG oslo_vmware.service [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualMachine.ExportVm with opID=oslo.vmware-b0a4a1a1-b3b8-4be8-82c2-1be285bd0e94 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  851.374418] env[65478]: DEBUG nova.scheduler.client.report [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  851.384932] env[65478]: DEBUG oslo_vmware.rw_handles [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lease: (returnval){
[  851.384932] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52201db1-029c-dda4-e60d-f8734f85e1d2"
[  851.384932] env[65478]:    _type = "HttpNfcLease"
[  851.384932] env[65478]:  } obtained for exporting VM: (result){
[  851.384932] env[65478]:    value = "vm-1161295"
[  851.384932] env[65478]:    _type = "VirtualMachine"
[  851.384932] env[65478]:  }. {{(pid=65478) _create_export_vm_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:481}}
[  851.385872] env[65478]: DEBUG oslo_vmware.api [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the lease: (returnval){
[  851.385872] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52201db1-029c-dda4-e60d-f8734f85e1d2"
[  851.385872] env[65478]:    _type = "HttpNfcLease"
[  851.385872] env[65478]:  } to be ready. {{(pid=65478) wait_for_lease_ready /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:462}}
[  851.394634] env[65478]: DEBUG oslo_vmware.api [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lease: (returnval){
[  851.394634] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52201db1-029c-dda4-e60d-f8734f85e1d2"
[  851.394634] env[65478]:    _type = "HttpNfcLease"
[  851.394634] env[65478]:  } is initializing. {{(pid=65478) _poll_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:490}}
[  851.618304] env[65478]: DEBUG nova.objects.instance [None req-d70311ab-860c-4cfb-ae25-ef90db886c8b tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Lazy-loading 'flavor' on Instance uuid 28200981-9217-4395-b0a8-c154624c7a1c {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  851.884334] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.786s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  851.885828] env[65478]: DEBUG oslo_concurrency.lockutils [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 21.604s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  851.892046] env[65478]: INFO nova.compute.manager [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Migrating
[  851.892297] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  851.892414] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Acquired lock "compute-rpcapi-router" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  851.895959] env[65478]: INFO nova.compute.claims [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: d4d3cf75-1781-46ed-afb2-44e6f2c048e2] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  851.901869] env[65478]: DEBUG oslo_vmware.api [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lease: (returnval){
[  851.901869] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52201db1-029c-dda4-e60d-f8734f85e1d2"
[  851.901869] env[65478]:    _type = "HttpNfcLease"
[  851.901869] env[65478]:  } is ready. {{(pid=65478) _poll_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:487}}
[  851.902092] env[65478]: DEBUG oslo_vmware.rw_handles [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VIM API for reading info of lease: (returnval){
[  851.902092] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52201db1-029c-dda4-e60d-f8734f85e1d2"
[  851.902092] env[65478]:    _type = "HttpNfcLease"
[  851.902092] env[65478]:  }. {{(pid=65478) _create_export_vm_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:486}}
[  851.902902] env[65478]: DEBUG oslo_vmware.service [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0f8763cb-e045-43a9-952d-f22353aaf3d1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  851.920387] env[65478]: DEBUG oslo_vmware.rw_handles [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Found VMDK URL: https://esx7c1n3.openstack.eu-de-1.cloud.sap/nfc/5223517f-6307-06d6-64e1-359774aec8ce/disk-0.vmdk from lease info. {{(pid=65478) _find_vmdk_url /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:531}}
[  851.920387] env[65478]: DEBUG oslo_vmware.rw_handles [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Opening URL: https://esx7c1n3.openstack.eu-de-1.cloud.sap/nfc/5223517f-6307-06d6-64e1-359774aec8ce/disk-0.vmdk for reading. {{(pid=65478) _create_read_connection /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:99}}
[  851.934713] env[65478]: DEBUG oslo_concurrency.lockutils [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Acquiring lock "28200981-9217-4395-b0a8-c154624c7a1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  852.013663] env[65478]: DEBUG nova.compute.manager [req-0a1b810f-7c3e-42ce-a300-a6f40dc7d64c req-207cb104-1e62-41eb-829e-98408793073f service nova] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Received event network-changed-d0ba0aff-4125-4028-bb87-c0e783d1e066 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  852.015138] env[65478]: DEBUG nova.compute.manager [req-0a1b810f-7c3e-42ce-a300-a6f40dc7d64c req-207cb104-1e62-41eb-829e-98408793073f service nova] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Refreshing instance network info cache due to event network-changed-d0ba0aff-4125-4028-bb87-c0e783d1e066. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  852.015552] env[65478]: DEBUG oslo_concurrency.lockutils [req-0a1b810f-7c3e-42ce-a300-a6f40dc7d64c req-207cb104-1e62-41eb-829e-98408793073f service nova] Acquiring lock "refresh_cache-ef569806-5f50-44b9-a4a9-0107328a8dfe" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  852.015989] env[65478]: DEBUG oslo_concurrency.lockutils [req-0a1b810f-7c3e-42ce-a300-a6f40dc7d64c req-207cb104-1e62-41eb-829e-98408793073f service nova] Acquired lock "refresh_cache-ef569806-5f50-44b9-a4a9-0107328a8dfe" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  852.016708] env[65478]: DEBUG nova.network.neutron [req-0a1b810f-7c3e-42ce-a300-a6f40dc7d64c req-207cb104-1e62-41eb-829e-98408793073f service nova] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Refreshing network info cache for port d0ba0aff-4125-4028-bb87-c0e783d1e066 {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  852.049901] env[65478]: DEBUG oslo_vmware.service [-] Invoking HttpNfcLease.HttpNfcLeaseProgress with opID=oslo.vmware-1fce1d6a-f4ba-442b-9560-dae49a3a6a3c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  852.055448] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'oslo_vmware.rw_handles.VmdkHandle.update_progress' sleeping for 59.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[  852.130751] env[65478]: DEBUG oslo_concurrency.lockutils [None req-d70311ab-860c-4cfb-ae25-ef90db886c8b tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Lock "28200981-9217-4395-b0a8-c154624c7a1c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.886s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  852.131575] env[65478]: DEBUG oslo_concurrency.lockutils [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Lock "28200981-9217-4395-b0a8-c154624c7a1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.197s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  852.131855] env[65478]: DEBUG oslo_concurrency.lockutils [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Acquiring lock "28200981-9217-4395-b0a8-c154624c7a1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  852.132053] env[65478]: DEBUG oslo_concurrency.lockutils [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Lock "28200981-9217-4395-b0a8-c154624c7a1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  852.132179] env[65478]: DEBUG oslo_concurrency.lockutils [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Lock "28200981-9217-4395-b0a8-c154624c7a1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  852.137255] env[65478]: INFO nova.compute.manager [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Terminating instance
[  852.519731] env[65478]: WARNING neutronclient.v2_0.client [req-0a1b810f-7c3e-42ce-a300-a6f40dc7d64c req-207cb104-1e62-41eb-829e-98408793073f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  852.641024] env[65478]: INFO nova.compute.rpcapi [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Automatically selected compute RPC version 6.4 from minimum service version 70
[  852.641534] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Releasing lock "compute-rpcapi-router" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  852.650717] env[65478]: DEBUG nova.compute.manager [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[  852.651558] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  852.652078] env[65478]: DEBUG oslo_vmware.service [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-5aee1f40-0203-4d8a-8cf0-d680ca1c9e89 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  852.662680] env[65478]: DEBUG oslo_vmware.api [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for the task: (returnval){
[  852.662680] env[65478]:    value = "task-6011821"
[  852.662680] env[65478]:    _type = "Task"
[  852.662680] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  852.672355] env[65478]: DEBUG oslo_vmware.api [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011821, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  853.178432] env[65478]: DEBUG oslo_vmware.api [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011821, 'name': PowerOffVM_Task, 'duration_secs': 0.235387} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  853.178432] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  853.178578] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Volume detach. Driver type: vmdk {{(pid=65478) detach_volume /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:646}}
[  853.178733] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] _detach_volume_vmdk: {'driver_volume_type': 'vmdk', 'data': {'volume': 'vm-1161293', 'volume_id': '184b333f-06cf-43b1-b4cc-ef9df913627b', 'name': 'volume-184b333f-06cf-43b1-b4cc-ef9df913627b', 'profile_id': None, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'physical_block_size': '512', 'logical_block_size': '512', 'enforce_multipath': False}, 'status': 'reserved', 'instance': '28200981-9217-4395-b0a8-c154624c7a1c', 'attached_at': '', 'detached_at': '', 'volume_id': '184b333f-06cf-43b1-b4cc-ef9df913627b', 'serial': '184b333f-06cf-43b1-b4cc-ef9df913627b'} {{(pid=65478) _detach_volume_vmdk /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:571}}
[  853.179672] env[65478]: DEBUG oslo_vmware.service [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9c6b2446-ae08-4f04-9ea9-84ea103dee12 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  853.208462] env[65478]: DEBUG oslo_vmware.service [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-654c99f8-5b94-4305-a3e1-b64c7179e4f8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  853.223054] env[65478]: DEBUG oslo_vmware.service [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-eb1eb65d-afe2-47e1-a84a-77e7b730b407 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  853.251409] env[65478]: DEBUG oslo_vmware.service [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1510e183-bd02-43af-9333-643f7892303d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  853.255527] env[65478]: WARNING neutronclient.v2_0.client [req-0a1b810f-7c3e-42ce-a300-a6f40dc7d64c req-207cb104-1e62-41eb-829e-98408793073f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  853.272126] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] The volume has not been displaced from its original location: [datastore1] volume-184b333f-06cf-43b1-b4cc-ef9df913627b/volume-184b333f-06cf-43b1-b4cc-ef9df913627b.vmdk. No consolidation needed. {{(pid=65478) _consolidate_vmdk_volume /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:504}}
[  853.279764] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Reconfiguring VM instance instance-00000020 to detach disk 2001 {{(pid=65478) detach_disk_from_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:122}}
[  853.279764] env[65478]: DEBUG oslo_vmware.service [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-2b52b6f6-96db-47b5-acc3-05344e90a2d2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  853.293976] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Acquiring lock "refresh_cache-6f6c4cda-9439-47dd-810c-25b0516585e6" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  853.294159] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Acquired lock "refresh_cache-6f6c4cda-9439-47dd-810c-25b0516585e6" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  853.295173] env[65478]: DEBUG nova.network.neutron [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  853.307749] env[65478]: DEBUG oslo_vmware.api [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for the task: (returnval){
[  853.307749] env[65478]:    value = "task-6011822"
[  853.307749] env[65478]:    _type = "Task"
[  853.307749] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  853.325897] env[65478]: DEBUG oslo_vmware.api [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011822, 'name': ReconfigVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  853.348833] env[65478]: DEBUG nova.network.neutron [req-0a1b810f-7c3e-42ce-a300-a6f40dc7d64c req-207cb104-1e62-41eb-829e-98408793073f service nova] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Updated VIF entry in instance network info cache for port d0ba0aff-4125-4028-bb87-c0e783d1e066. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  853.349165] env[65478]: DEBUG nova.network.neutron [req-0a1b810f-7c3e-42ce-a300-a6f40dc7d64c req-207cb104-1e62-41eb-829e-98408793073f service nova] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Updating instance_info_cache with network_info: [{"id": "d0ba0aff-4125-4028-bb87-c0e783d1e066", "address": "fa:16:3e:03:25:35", "network": {"id": "2ed010d6-4573-4056-a189-22d86fca4369", "bridge": "br-int", "label": "tempest-ServersWithSpecificFlavorTestJSON-2103777099-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "10.180.180.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "70efc035843c47d69ec6a42f446a2b91", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "b250e561-3be3-4bae-be1a-162251b1ee31", "external-id": "nsx-vlan-transportzone-464", "segmentation_id": 464, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapd0ba0aff-41", "ovs_interfaceid": "d0ba0aff-4125-4028-bb87-c0e783d1e066", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  853.534473] env[65478]: DEBUG oslo_vmware.service [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-19115bf7-1edf-4d4e-b485-fede94b514b9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  853.546651] env[65478]: DEBUG oslo_vmware.service [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-2c292e5e-afd8-40b8-abb9-38115b876c10 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  853.583239] env[65478]: DEBUG oslo_vmware.service [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1401dd91-efad-45ae-85e8-036a0079c838 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  853.592336] env[65478]: DEBUG oslo_vmware.service [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ccc1d485-cf3a-4277-8e0a-dce73608d3a2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  853.608444] env[65478]: DEBUG nova.compute.provider_tree [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  853.801695] env[65478]: WARNING neutronclient.v2_0.client [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  853.822509] env[65478]: DEBUG oslo_vmware.api [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011822, 'name': ReconfigVM_Task, 'duration_secs': 0.233031} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  853.823185] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Reconfigured VM instance instance-00000020 to detach disk 2001 {{(pid=65478) detach_disk_from_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:127}}
[  853.828853] env[65478]: DEBUG oslo_vmware.service [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-e9b8047f-1a3f-4f2c-a260-c36238c2f421 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  853.851974] env[65478]: DEBUG oslo_vmware.api [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for the task: (returnval){
[  853.851974] env[65478]:    value = "task-6011823"
[  853.851974] env[65478]:    _type = "Task"
[  853.851974] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  853.858721] env[65478]: DEBUG oslo_concurrency.lockutils [req-0a1b810f-7c3e-42ce-a300-a6f40dc7d64c req-207cb104-1e62-41eb-829e-98408793073f service nova] Releasing lock "refresh_cache-ef569806-5f50-44b9-a4a9-0107328a8dfe" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  853.868024] env[65478]: DEBUG oslo_vmware.api [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011823, 'name': ReconfigVM_Task} progress is 10%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  854.027600] env[65478]: WARNING neutronclient.v2_0.client [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  854.114495] env[65478]: DEBUG nova.scheduler.client.report [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  854.175541] env[65478]: DEBUG nova.network.neutron [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Updating instance_info_cache with network_info: [{"id": "0c0d9e92-abc5-4d72-881a-e5bca5e8ff47", "address": "fa:16:3e:08:d3:02", "network": {"id": "8419dcc5-ccb7-4667-a5ee-3f07016ddecd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "eb20b7ec77e847179c9940510a8b48bf", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "ec3f9e71-839a-429d-b211-d3dfc98ca4f6", "external-id": "nsx-vlan-transportzone-5", "segmentation_id": 5, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap0c0d9e92-ab", "ovs_interfaceid": "0c0d9e92-abc5-4d72-881a-e5bca5e8ff47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  854.192997] env[65478]: WARNING nova.utils [None req-7c57535a-5a30-4907-a344-cf2e67d7a18f tempest-ServerRescueNegativeTestJSON-598487790 tempest-ServerRescueNegativeTestJSON-598487790-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d9202e7250> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  854.365398] env[65478]: DEBUG oslo_vmware.api [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011823, 'name': ReconfigVM_Task, 'duration_secs': 0.239196} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  854.366050] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Detached VMDK: {'driver_volume_type': 'vmdk', 'data': {'volume': 'vm-1161293', 'volume_id': '184b333f-06cf-43b1-b4cc-ef9df913627b', 'name': 'volume-184b333f-06cf-43b1-b4cc-ef9df913627b', 'profile_id': None, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'physical_block_size': '512', 'logical_block_size': '512', 'enforce_multipath': False}, 'status': 'reserved', 'instance': '28200981-9217-4395-b0a8-c154624c7a1c', 'attached_at': '', 'detached_at': '', 'volume_id': '184b333f-06cf-43b1-b4cc-ef9df913627b', 'serial': '184b333f-06cf-43b1-b4cc-ef9df913627b'} {{(pid=65478) _detach_volume_vmdk /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:605}}
[  854.367042] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  854.367493] env[65478]: DEBUG oslo_vmware.service [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b9d7a473-ac3e-4c3c-9f2c-da48e19da0b6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  854.379321] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  854.380349] env[65478]: DEBUG oslo_vmware.service [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-070d26d9-8584-49a9-a5f9-30c98d3a2eed {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  854.454495] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  854.454860] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Deleting contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  854.454860] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Deleting the datastore file [datastore1] 28200981-9217-4395-b0a8-c154624c7a1c {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  854.455556] env[65478]: DEBUG oslo_vmware.service [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-a160879d-8463-4418-b9eb-aa87dae158a0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  854.468237] env[65478]: DEBUG oslo_vmware.api [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for the task: (returnval){
[  854.468237] env[65478]:    value = "task-6011825"
[  854.468237] env[65478]:    _type = "Task"
[  854.468237] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  854.479475] env[65478]: DEBUG oslo_vmware.api [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011825, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  854.548034] env[65478]: DEBUG oslo_concurrency.lockutils [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Acquiring lock "98b2d40a-0c59-4540-b60e-17e5206dea42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  854.548343] env[65478]: DEBUG oslo_concurrency.lockutils [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Lock "98b2d40a-0c59-4540-b60e-17e5206dea42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  854.548343] env[65478]: DEBUG oslo_concurrency.lockutils [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Acquiring lock "98b2d40a-0c59-4540-b60e-17e5206dea42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  854.549928] env[65478]: DEBUG oslo_concurrency.lockutils [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Lock "98b2d40a-0c59-4540-b60e-17e5206dea42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  854.549928] env[65478]: DEBUG oslo_concurrency.lockutils [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Lock "98b2d40a-0c59-4540-b60e-17e5206dea42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  854.552749] env[65478]: INFO nova.compute.manager [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Terminating instance
[  854.619917] env[65478]: DEBUG oslo_concurrency.lockutils [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.734s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  854.621111] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 22.537s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  854.625299] env[65478]: DEBUG nova.compute.manager [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: d4d3cf75-1781-46ed-afb2-44e6f2c048e2] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  854.625821] env[65478]: INFO nova.compute.claims [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] [instance: ec1a8c79-d97b-4eb0-b024-1b0c86ccab17] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  854.678530] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Releasing lock "refresh_cache-6f6c4cda-9439-47dd-810c-25b0516585e6" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  854.980471] env[65478]: DEBUG oslo_vmware.api [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011825, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  855.058205] env[65478]: DEBUG nova.compute.manager [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[  855.059025] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  855.063406] env[65478]: DEBUG oslo_vmware.service [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8d1d3a3b-e9df-4d98-a9ef-2d1e286808d7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  855.072959] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  855.074966] env[65478]: DEBUG oslo_vmware.service [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-bcd9ba5a-6393-4a3e-9ac4-80296516e157 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  855.083473] env[65478]: DEBUG oslo_vmware.api [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Waiting for the task: (returnval){
[  855.083473] env[65478]:    value = "task-6011826"
[  855.083473] env[65478]:    _type = "Task"
[  855.083473] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  855.094601] env[65478]: DEBUG oslo_vmware.api [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Task: {'id': task-6011826, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  855.131360] env[65478]: WARNING nova.utils [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] The MainProcess.default pool does not have free threads so the task <bound method ComputeManager._allocate_network_async of <nova.compute.manager.ComputeManager object at 0x73d94c2e6500>> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  855.131737] env[65478]: DEBUG nova.compute.utils [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  855.480686] env[65478]: DEBUG oslo_vmware.api [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Task: {'id': task-6011825, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.615105} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  855.480888] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  855.481248] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Deleted contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  855.481397] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  855.481530] env[65478]: INFO nova.compute.manager [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Took 2.83 seconds to destroy the instance on the hypervisor.
[  855.482228] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  855.482688] env[65478]: DEBUG nova.compute.manager [-] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[  855.482800] env[65478]: DEBUG nova.network.neutron [-] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[  855.483057] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  855.515952] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  855.594777] env[65478]: DEBUG oslo_vmware.api [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Task: {'id': task-6011826, 'name': PowerOffVM_Task, 'duration_secs': 0.247762} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  855.595128] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  855.595225] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  855.595516] env[65478]: DEBUG oslo_vmware.service [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-88fbe081-ca1f-4ee8-b303-165972992dbe {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  855.639623] env[65478]: DEBUG nova.compute.manager [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: d4d3cf75-1781-46ed-afb2-44e6f2c048e2] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  855.672855] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  855.673156] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Deleting contents of the VM from datastore datastore2 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  855.673223] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Deleting the datastore file [datastore2] 98b2d40a-0c59-4540-b60e-17e5206dea42 {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  855.673601] env[65478]: DEBUG oslo_vmware.service [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-ccd13dba-da84-4468-915d-1c23411f6681 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  855.685842] env[65478]: DEBUG oslo_vmware.api [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Waiting for the task: (returnval){
[  855.685842] env[65478]:    value = "task-6011828"
[  855.685842] env[65478]:    _type = "Task"
[  855.685842] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  855.695490] env[65478]: DEBUG oslo_vmware.api [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Task: {'id': task-6011828, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  856.197060] env[65478]: DEBUG oslo_vmware.api [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Task: {'id': task-6011828, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.179404} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  856.197464] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  856.198223] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Deleted contents of the VM from datastore datastore2 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  856.198358] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  856.198492] env[65478]: INFO nova.compute.manager [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Took 1.14 seconds to destroy the instance on the hypervisor.
[  856.203664] env[65478]: DEBUG oslo_vmware.service [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-433e675b-b876-4571-a011-a8306e6d589e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  856.207834] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  856.216358] env[65478]: DEBUG nova.compute.manager [-] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[  856.222219] env[65478]: DEBUG nova.network.neutron [-] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[  856.222513] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  856.227053] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Updating instance '6f6c4cda-9439-47dd-810c-25b0516585e6' progress to 0 {{(pid=65478) _update_instance_progress /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1352}}
[  856.236393] env[65478]: DEBUG oslo_vmware.service [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-fa2d3e43-9914-495e-8ca2-0a55049f5a30 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  856.252788] env[65478]: DEBUG oslo_vmware.service [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1b50035a-9a1a-44c3-8882-f70753f09e71 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  856.259724] env[65478]: DEBUG nova.network.neutron [-] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  856.296765] env[65478]: DEBUG oslo_vmware.service [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e912e4e2-25d1-4af1-9ec9-fbcbe220f4e2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  856.306650] env[65478]: DEBUG oslo_vmware.service [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8ad1334a-0649-4184-abe2-62b41d1c6952 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  856.324617] env[65478]: DEBUG nova.compute.provider_tree [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  856.330543] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  856.656686] env[65478]: DEBUG nova.compute.manager [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: d4d3cf75-1781-46ed-afb2-44e6f2c048e2] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  856.743293] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  856.743686] env[65478]: DEBUG oslo_vmware.service [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-93b4ff10-43bb-4b08-8fe9-7ab83574b122 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  856.751964] env[65478]: DEBUG oslo_vmware.api [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Waiting for the task: (returnval){
[  856.751964] env[65478]:    value = "task-6011829"
[  856.751964] env[65478]:    _type = "Task"
[  856.751964] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  856.761914] env[65478]: DEBUG oslo_vmware.api [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011829, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  856.762693] env[65478]: INFO nova.compute.manager [-] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Took 1.28 seconds to deallocate network for instance.
[  856.853708] env[65478]: ERROR nova.scheduler.client.report [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] [req-a8f09725-7c1a-4b6b-ab36-c8500ab9d196] Failed to update inventory to [{'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}}] for resource provider with UUID e3a5020e-0218-494b-ae38-8b55aa77f6f5.  Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n resource provider generation conflict  ", "code": "placement.concurrent_update", "request_id": "req-a8f09725-7c1a-4b6b-ab36-c8500ab9d196"}]}
[  856.881251] env[65478]: DEBUG nova.scheduler.client.report [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Refreshing inventories for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
[  856.902692] env[65478]: DEBUG nova.scheduler.client.report [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Updating ProviderTree inventory for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
[  856.902692] env[65478]: DEBUG nova.compute.provider_tree [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 93, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  856.914961] env[65478]: DEBUG nova.scheduler.client.report [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Refreshing aggregate associations for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5, aggregates: None {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
[  856.942834] env[65478]: DEBUG nova.scheduler.client.report [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Refreshing trait associations for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_VMDK,COMPUTE_IMAGE_TYPE_ISO,HW_ARCH_X86_64,COMPUTE_SAME_HOST_COLD_MIGRATE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
[  857.266535] env[65478]: DEBUG oslo_vmware.api [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011829, 'name': PowerOffVM_Task} progress is 100%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  857.370902] env[65478]: INFO nova.compute.manager [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Took 0.61 seconds to detach 1 volumes for instance.
[  857.505607] env[65478]: DEBUG oslo_vmware.service [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-90b6e4fe-4cad-46ee-a5e9-60ecbf955ac1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  857.514892] env[65478]: DEBUG oslo_vmware.service [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c8292c97-a159-4d87-b087-899ada0dfed5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  857.558779] env[65478]: DEBUG oslo_vmware.service [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0ca00fd6-0bed-4f9b-81fb-e5f5e03c2cf3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  857.569643] env[65478]: DEBUG oslo_vmware.service [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f2a27206-657f-4069-a2a7-c56aff7424c5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  857.585662] env[65478]: DEBUG nova.compute.provider_tree [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  857.764749] env[65478]: DEBUG oslo_vmware.api [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011829, 'name': PowerOffVM_Task, 'duration_secs': 0.69384} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  857.764749] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  857.764749] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Updating instance '6f6c4cda-9439-47dd-810c-25b0516585e6' progress to 17 {{(pid=65478) _update_instance_progress /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1352}}
[  857.827697] env[65478]: DEBUG nova.network.neutron [-] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  857.881241] env[65478]: DEBUG oslo_concurrency.lockutils [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  858.128308] env[65478]: DEBUG nova.scheduler.client.report [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Updated inventory for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with generation 63 in Placement from set_inventory_for_provider using data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}}
[  858.129488] env[65478]: DEBUG nova.compute.provider_tree [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Updating resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 generation from 63 to 64 during operation: update_inventory {{(pid=65478) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
[  858.130144] env[65478]: DEBUG nova.compute.provider_tree [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[  858.272019] env[65478]: DEBUG nova.virt.hardware [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  858.272019] env[65478]: DEBUG nova.virt.hardware [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  858.272019] env[65478]: DEBUG nova.virt.hardware [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  858.272019] env[65478]: DEBUG nova.virt.hardware [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  858.272262] env[65478]: DEBUG nova.virt.hardware [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  858.272262] env[65478]: DEBUG nova.virt.hardware [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  858.272262] env[65478]: DEBUG nova.virt.hardware [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  858.272262] env[65478]: DEBUG nova.virt.hardware [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  858.272262] env[65478]: DEBUG nova.virt.hardware [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  858.272402] env[65478]: DEBUG nova.virt.hardware [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  858.272402] env[65478]: DEBUG nova.virt.hardware [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  858.277562] env[65478]: DEBUG oslo_vmware.service [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-7a784e83-362b-423e-8917-d9e2e42cf5e4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  858.297105] env[65478]: DEBUG oslo_vmware.api [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Waiting for the task: (returnval){
[  858.297105] env[65478]:    value = "task-6011830"
[  858.297105] env[65478]:    _type = "Task"
[  858.297105] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  858.305939] env[65478]: DEBUG oslo_vmware.api [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011830, 'name': ReconfigVM_Task} progress is 5%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  858.330670] env[65478]: INFO nova.compute.manager [-] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Took 2.11 seconds to deallocate network for instance.
[  858.635973] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 4.016s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  858.636548] env[65478]: DEBUG nova.compute.manager [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] [instance: ec1a8c79-d97b-4eb0-b024-1b0c86ccab17] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  858.640434] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 26.483s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  858.645041] env[65478]: INFO nova.compute.claims [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] [instance: 25ec70f9-947b-4ebe-82df-1a1ddcc59360] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  858.808151] env[65478]: DEBUG oslo_vmware.api [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011830, 'name': ReconfigVM_Task, 'duration_secs': 0.285209} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  858.808528] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Updating instance '6f6c4cda-9439-47dd-810c-25b0516585e6' progress to 33 {{(pid=65478) _update_instance_progress /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1352}}
[  858.841568] env[65478]: DEBUG oslo_concurrency.lockutils [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  859.144160] env[65478]: WARNING nova.utils [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] The MainProcess.default pool does not have free threads so the task <bound method ComputeManager._allocate_network_async of <nova.compute.manager.ComputeManager object at 0x73d94c2e6500>> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  859.144660] env[65478]: DEBUG nova.compute.utils [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  859.315557] env[65478]: DEBUG nova.virt.hardware [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  859.315860] env[65478]: DEBUG nova.virt.hardware [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  859.315959] env[65478]: DEBUG nova.virt.hardware [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  859.316087] env[65478]: DEBUG nova.virt.hardware [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  859.316178] env[65478]: DEBUG nova.virt.hardware [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  859.316284] env[65478]: DEBUG nova.virt.hardware [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  859.316452] env[65478]: DEBUG nova.virt.hardware [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  859.316569] env[65478]: DEBUG nova.virt.hardware [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  859.316696] env[65478]: DEBUG nova.virt.hardware [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  859.316818] env[65478]: DEBUG nova.virt.hardware [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  859.317063] env[65478]: DEBUG nova.virt.hardware [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  859.324614] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Reconfiguring VM instance instance-0000001c to detach disk 2000 {{(pid=65478) detach_disk_from_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:122}}
[  859.324930] env[65478]: DEBUG oslo_vmware.service [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-db019a3d-62b1-42c4-acbc-c598c2651e19 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  859.346430] env[65478]: DEBUG oslo_vmware.api [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Waiting for the task: (returnval){
[  859.346430] env[65478]:    value = "task-6011831"
[  859.346430] env[65478]:    _type = "Task"
[  859.346430] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  859.356353] env[65478]: DEBUG oslo_vmware.api [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011831, 'name': ReconfigVM_Task} progress is 5%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  859.648332] env[65478]: DEBUG nova.compute.manager [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] [instance: ec1a8c79-d97b-4eb0-b024-1b0c86ccab17] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  859.860833] env[65478]: DEBUG oslo_vmware.api [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011831, 'name': ReconfigVM_Task, 'duration_secs': 0.408953} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  859.861239] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Reconfigured VM instance instance-0000001c to detach disk 2000 {{(pid=65478) detach_disk_from_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:127}}
[  859.862190] env[65478]: DEBUG oslo_vmware.service [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-90fad2f5-0007-4d8f-b8ae-660c8bbed52d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  859.888616] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Reconfiguring VM instance instance-0000001c to attach disk [datastore1] 6f6c4cda-9439-47dd-810c-25b0516585e6/6f6c4cda-9439-47dd-810c-25b0516585e6.vmdk or device None with type thin {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  859.889065] env[65478]: DEBUG oslo_vmware.service [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-9587d614-26e3-491f-b9ef-098d97307c3c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  859.915160] env[65478]: DEBUG oslo_vmware.api [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Waiting for the task: (returnval){
[  859.915160] env[65478]:    value = "task-6011832"
[  859.915160] env[65478]:    _type = "Task"
[  859.915160] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  859.927228] env[65478]: DEBUG oslo_vmware.api [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011832, 'name': ReconfigVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  860.124711] env[65478]: DEBUG oslo_vmware.service [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e24b50a8-4a34-4dbc-82f1-9e00ea35139c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  860.133105] env[65478]: DEBUG oslo_vmware.service [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-405461e6-7270-4a58-9d54-8cb0fc8057b8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  860.171707] env[65478]: DEBUG oslo_vmware.service [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-118cec35-6eeb-4abc-b82d-3ef17986729f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  860.181123] env[65478]: DEBUG oslo_vmware.service [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9fdc18ef-e15a-4a27-a4f9-a6ff45a6f4ee {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  860.197764] env[65478]: DEBUG nova.compute.provider_tree [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  860.427952] env[65478]: DEBUG oslo_vmware.api [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011832, 'name': ReconfigVM_Task} progress is 14%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  860.668087] env[65478]: DEBUG nova.compute.manager [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] [instance: ec1a8c79-d97b-4eb0-b024-1b0c86ccab17] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  860.701729] env[65478]: DEBUG nova.scheduler.client.report [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  860.928754] env[65478]: DEBUG oslo_vmware.api [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011832, 'name': ReconfigVM_Task, 'duration_secs': 0.779699} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  860.929137] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Reconfigured VM instance instance-0000001c to attach disk [datastore1] 6f6c4cda-9439-47dd-810c-25b0516585e6/6f6c4cda-9439-47dd-810c-25b0516585e6.vmdk or device None with type thin {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  860.929215] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Updating instance '6f6c4cda-9439-47dd-810c-25b0516585e6' progress to 50 {{(pid=65478) _update_instance_progress /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1352}}
[  861.207155] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.570s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  861.207967] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 27.344s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  861.208275] env[65478]: DEBUG nova.compute.manager [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] [instance: 25ec70f9-947b-4ebe-82df-1a1ddcc59360] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  861.210759] env[65478]: DEBUG nova.objects.instance [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Lazy-loading 'resources' on Instance uuid eb466e5e-a499-4856-9c12-c7ca87b53230 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  861.435923] env[65478]: DEBUG oslo_vmware.service [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-974b444f-aa6f-417f-948d-02984b8f24c6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  861.457774] env[65478]: DEBUG oslo_vmware.service [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-97fe93c2-ed61-4741-83fe-ebff6974833d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  861.479832] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Updating instance '6f6c4cda-9439-47dd-810c-25b0516585e6' progress to 67 {{(pid=65478) _update_instance_progress /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1352}}
[  861.713498] env[65478]: WARNING nova.utils [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] The MainProcess.default pool does not have free threads so the task <bound method ComputeManager._allocate_network_async of <nova.compute.manager.ComputeManager object at 0x73d94c2e6500>> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  861.716292] env[65478]: DEBUG nova.compute.utils [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  861.986151] env[65478]: WARNING neutronclient.v2_0.client [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  861.986535] env[65478]: WARNING neutronclient.v2_0.client [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  862.028891] env[65478]: DEBUG nova.network.neutron [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Port 0c0d9e92-abc5-4d72-881a-e5bca5e8ff47 binding to destination host cpu-1 is already ACTIVE {{(pid=65478) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
[  862.219406] env[65478]: DEBUG nova.compute.manager [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] [instance: 25ec70f9-947b-4ebe-82df-1a1ddcc59360] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  862.250332] env[65478]: DEBUG oslo_vmware.service [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-38318e3f-6210-4461-b279-36a62793d7fd {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  862.262086] env[65478]: DEBUG oslo_vmware.service [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-89ef0653-3a94-481e-b585-ea36cc5fcda1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  862.298481] env[65478]: DEBUG oslo_vmware.service [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d49a1576-cf8a-443c-b1a7-1c2ca8330cf2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  862.308029] env[65478]: DEBUG oslo_vmware.service [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-027ed958-02c7-4d55-879b-c193fc95ba6f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  862.323885] env[65478]: DEBUG nova.compute.provider_tree [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  862.828230] env[65478]: DEBUG nova.scheduler.client.report [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  863.055817] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Acquiring lock "6f6c4cda-9439-47dd-810c-25b0516585e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  863.056220] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Lock "6f6c4cda-9439-47dd-810c-25b0516585e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  863.056286] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Lock "6f6c4cda-9439-47dd-810c-25b0516585e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  863.232277] env[65478]: DEBUG nova.compute.manager [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] [instance: 25ec70f9-947b-4ebe-82df-1a1ddcc59360] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  863.333784] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.126s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  863.336235] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 27.106s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  863.337944] env[65478]: INFO nova.compute.claims [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] [instance: 8d032b6f-86df-4397-8727-d4336f973368] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  863.357218] env[65478]: INFO nova.scheduler.client.report [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Deleted allocations for instance eb466e5e-a499-4856-9c12-c7ca87b53230
[  863.439401] env[65478]: DEBUG nova.virt.hardware [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  863.441215] env[65478]: DEBUG nova.virt.hardware [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  863.444021] env[65478]: DEBUG nova.virt.hardware [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  863.444223] env[65478]: DEBUG nova.virt.hardware [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  863.444369] env[65478]: DEBUG nova.virt.hardware [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  863.444449] env[65478]: DEBUG nova.virt.hardware [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  863.444633] env[65478]: DEBUG nova.virt.hardware [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  863.444757] env[65478]: DEBUG nova.virt.hardware [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  863.444888] env[65478]: DEBUG nova.virt.hardware [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  863.445021] env[65478]: DEBUG nova.virt.hardware [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  863.445158] env[65478]: DEBUG nova.virt.hardware [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  863.446247] env[65478]: DEBUG oslo_vmware.service [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-07fe23c0-035b-4536-bf05-69887147da2e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  863.452243] env[65478]: DEBUG nova.virt.hardware [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  863.452780] env[65478]: DEBUG nova.virt.hardware [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  863.454753] env[65478]: DEBUG nova.virt.hardware [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  863.459040] env[65478]: DEBUG nova.virt.hardware [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  863.459170] env[65478]: DEBUG nova.virt.hardware [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  863.459285] env[65478]: DEBUG nova.virt.hardware [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  863.459552] env[65478]: DEBUG oslo_vmware.service [None req-20919901-e975-4834-8ace-fafe6668b786 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9d15760b-8e1c-4251-8d2e-b7abae94bec7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  863.467954] env[65478]: DEBUG nova.virt.hardware [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  863.469961] env[65478]: DEBUG nova.virt.hardware [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  863.476135] env[65478]: DEBUG nova.virt.hardware [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  863.476548] env[65478]: DEBUG nova.virt.hardware [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  863.476688] env[65478]: DEBUG nova.virt.hardware [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  863.484811] env[65478]: DEBUG nova.virt.hardware [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  863.485317] env[65478]: DEBUG nova.virt.hardware [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  863.486399] env[65478]: DEBUG oslo_vmware.rw_handles [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Getting lease state for https://esx7c1n1.openstack.eu-de-1.cloud.sap/nfc/52ecaf25-bea9-d2d8-f1c9-dec486a0cb11/disk-0.vmdk. {{(pid=65478) _release_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:423}}
[  863.487321] env[65478]: DEBUG nova.virt.hardware [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  863.488593] env[65478]: DEBUG oslo_vmware.service [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1d0c4edb-e2e5-48a6-8fa4-cd069d87e648 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  863.490980] env[65478]: DEBUG oslo_vmware.service [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9cd2eeac-543e-4634-b63f-ad4b1e90ea81 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  863.493916] env[65478]: DEBUG nova.virt.hardware [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  863.494707] env[65478]: DEBUG nova.virt.hardware [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  863.498910] env[65478]: DEBUG oslo_vmware.service [None req-7d4a47fa-adc3-45f2-b6c2-4418878e7ec3 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6592f46c-a03e-449d-b154-e34e7aaa9db5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  863.505323] env[65478]: DEBUG nova.virt.hardware [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  863.505623] env[65478]: DEBUG nova.virt.hardware [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  863.505856] env[65478]: DEBUG nova.virt.hardware [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  863.506180] env[65478]: DEBUG nova.virt.hardware [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  863.506319] env[65478]: DEBUG nova.virt.hardware [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  863.506456] env[65478]: DEBUG nova.virt.hardware [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  863.507601] env[65478]: DEBUG oslo_vmware.rw_handles [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Lease for https://esx7c1n1.openstack.eu-de-1.cloud.sap/nfc/52ecaf25-bea9-d2d8-f1c9-dec486a0cb11/disk-0.vmdk is in state: ready. {{(pid=65478) _release_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:430}}
[  863.508333] env[65478]: DEBUG oslo_vmware.service [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8cfc7095-a0fa-482b-94e1-b1485457a014 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  863.520796] env[65478]: ERROR oslo_vmware.rw_handles [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Aborting lease for https://esx7c1n1.openstack.eu-de-1.cloud.sap/nfc/52ecaf25-bea9-d2d8-f1c9-dec486a0cb11/disk-0.vmdk due to incomplete transfer.
[  863.522909] env[65478]: DEBUG oslo_vmware.service [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking HttpNfcLease.HttpNfcLeaseAbort with opID=oslo.vmware-57368108-8de7-41a7-a20c-a80592a08862 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  863.528422] env[65478]: DEBUG oslo_vmware.service [None req-54597f04-62fe-4b2b-b288-38aeea833ffb tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-40f6bfe3-1074-4186-8c38-a8152b29c0aa {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  863.535286] env[65478]: DEBUG oslo_vmware.rw_handles [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Closed VMDK read handle for https://esx7c1n1.openstack.eu-de-1.cloud.sap/nfc/52ecaf25-bea9-d2d8-f1c9-dec486a0cb11/disk-0.vmdk. {{(pid=65478) close /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:735}}
[  863.535286] env[65478]: DEBUG nova.virt.vmwareapi.images [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Uploaded image 5d1ee82c-c0b5-44a0-b784-11f74451c1fd to the Glance image server {{(pid=65478) upload_image_stream_optimized /opt/stack/nova/nova/virt/vmwareapi/images.py:472}}
[  863.536380] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Destroying the VM {{(pid=65478) destroy_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1368}}
[  863.537277] env[65478]: DEBUG oslo_vmware.service [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking VirtualMachine.Destroy_Task with opID=oslo.vmware-375c2c51-e733-4a92-a8f8-ba437e451d6f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  863.553410] env[65478]: DEBUG oslo_vmware.api [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Waiting for the task: (returnval){
[  863.553410] env[65478]:    value = "task-6011833"
[  863.553410] env[65478]:    _type = "Task"
[  863.553410] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  863.564871] env[65478]: DEBUG oslo_vmware.api [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011833, 'name': Destroy_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  863.866169] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7f5ecc53-2988-4973-8c6d-22f1056c600f tempest-ServersTestManualDisk-1671122585 tempest-ServersTestManualDisk-1671122585-project-member] Lock "eb466e5e-a499-4856-9c12-c7ca87b53230" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 33.869s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  863.983476] env[65478]: DEBUG nova.compute.manager [req-bc64886b-6489-43ce-9b60-1538c5dcd55e req-d228f95e-362a-46ed-a1a8-0faea6894075 service nova] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Received event network-vif-deleted-f0b49860-9c56-46f5-9519-2051bdc60f75 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  864.065425] env[65478]: DEBUG oslo_vmware.api [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011833, 'name': Destroy_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  864.068473] env[65478]: WARNING neutronclient.v2_0.client [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  864.129457] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Acquiring lock "refresh_cache-6f6c4cda-9439-47dd-810c-25b0516585e6" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  864.129587] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Acquired lock "refresh_cache-6f6c4cda-9439-47dd-810c-25b0516585e6" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  864.129722] env[65478]: DEBUG nova.network.neutron [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  864.133541] env[65478]: DEBUG nova.compute.manager [req-593b58e5-6d6a-4021-a894-f7b0f6c15e3e req-620a9698-b256-48d5-bdaf-ca2ccdde61b2 service nova] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Received event network-vif-deleted-320b5203-7ff1-4f52-a15b-995d50391e39 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  864.446809] env[65478]: WARNING nova.utils [None req-4813ad16-0d64-47b1-a1b4-2fcb56aacb9e tempest-ServerRescueNegativeTestJSON-598487790 tempest-ServerRescueNegativeTestJSON-598487790-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8fc73d120> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  864.565833] env[65478]: DEBUG oslo_vmware.api [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011833, 'name': Destroy_Task} progress is 33%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  864.634282] env[65478]: WARNING neutronclient.v2_0.client [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  864.865595] env[65478]: WARNING neutronclient.v2_0.client [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  864.970055] env[65478]: DEBUG oslo_vmware.service [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-02678935-5bee-469d-ac5d-232e80241a78 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  864.982091] env[65478]: DEBUG oslo_vmware.service [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-461444fe-ae97-4ec4-a2ce-bca08db94dc4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  865.016139] env[65478]: DEBUG oslo_vmware.service [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1c91c660-7cc9-4495-91bd-51626132c2a5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  865.025849] env[65478]: DEBUG oslo_vmware.service [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-82fd1d53-b69b-404d-9a10-24d4d3c1e31f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  865.047356] env[65478]: DEBUG nova.compute.provider_tree [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  865.066264] env[65478]: DEBUG oslo_vmware.api [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011833, 'name': Destroy_Task, 'duration_secs': 1.106309} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  865.067496] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Destroyed the VM
[  865.067656] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Deleting Snapshot of the VM instance {{(pid=65478) _delete_vm_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:932}}
[  865.068012] env[65478]: DEBUG oslo_vmware.service [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking VirtualMachineSnapshot.RemoveSnapshot_Task with opID=oslo.vmware-654931b2-a05e-4afb-8a46-3f192cf2d9f0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  865.071685] env[65478]: DEBUG nova.network.neutron [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Updating instance_info_cache with network_info: [{"id": "0c0d9e92-abc5-4d72-881a-e5bca5e8ff47", "address": "fa:16:3e:08:d3:02", "network": {"id": "8419dcc5-ccb7-4667-a5ee-3f07016ddecd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "eb20b7ec77e847179c9940510a8b48bf", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "ec3f9e71-839a-429d-b211-d3dfc98ca4f6", "external-id": "nsx-vlan-transportzone-5", "segmentation_id": 5, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap0c0d9e92-ab", "ovs_interfaceid": "0c0d9e92-abc5-4d72-881a-e5bca5e8ff47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  865.080140] env[65478]: DEBUG oslo_vmware.api [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Waiting for the task: (returnval){
[  865.080140] env[65478]:    value = "task-6011834"
[  865.080140] env[65478]:    _type = "Task"
[  865.080140] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  865.094476] env[65478]: DEBUG oslo_vmware.api [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011834, 'name': RemoveSnapshot_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  865.349140] env[65478]: WARNING nova.utils [None req-3952df7b-76b1-4d8c-a45e-9ef68215a457 tempest-ServerMetadataTestJSON-1143504731 tempest-ServerMetadataTestJSON-1143504731-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d938113ac0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  865.468354] env[65478]: WARNING nova.utils [None req-1f54227a-2767-40a2-84b1-98028bfd89f5 tempest-ListServersNegativeTestJSON-1094007334 tempest-ListServersNegativeTestJSON-1094007334-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d93a96e170> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  865.507964] env[65478]: WARNING nova.utils [None req-1f54227a-2767-40a2-84b1-98028bfd89f5 tempest-ListServersNegativeTestJSON-1094007334 tempest-ListServersNegativeTestJSON-1094007334-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8fc73ee60> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  865.549458] env[65478]: WARNING nova.utils [None req-1f54227a-2767-40a2-84b1-98028bfd89f5 tempest-ListServersNegativeTestJSON-1094007334 tempest-ListServersNegativeTestJSON-1094007334-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d93a96fc70> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  865.551094] env[65478]: DEBUG nova.scheduler.client.report [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  865.575575] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Releasing lock "refresh_cache-6f6c4cda-9439-47dd-810c-25b0516585e6" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  865.601042] env[65478]: DEBUG oslo_vmware.api [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011834, 'name': RemoveSnapshot_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  866.056659] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.723s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  866.059169] env[65478]: DEBUG oslo_concurrency.lockutils [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 24.878s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  866.063664] env[65478]: DEBUG nova.compute.manager [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] [instance: 8d032b6f-86df-4397-8727-d4336f973368] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  866.069406] env[65478]: INFO nova.compute.claims [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] [instance: e2e07720-a241-4382-a684-0835b199e37d] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  866.097246] env[65478]: DEBUG oslo_vmware.api [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011834, 'name': RemoveSnapshot_Task} progress is 82%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  866.118846] env[65478]: DEBUG oslo_vmware.service [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ae6a9261-a829-42bf-86bc-fb7b54b3fd72 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  866.153171] env[65478]: DEBUG oslo_vmware.service [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-2cb8a864-ca7c-4405-8131-111f4d104ead {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  866.162682] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Updating instance '6f6c4cda-9439-47dd-810c-25b0516585e6' progress to 83 {{(pid=65478) _update_instance_progress /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1352}}
[  866.578176] env[65478]: WARNING nova.utils [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] The MainProcess.default pool does not have free threads so the task <bound method ComputeManager._allocate_network_async of <nova.compute.manager.ComputeManager object at 0x73d94c2e6500>> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  866.578661] env[65478]: DEBUG nova.compute.utils [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  866.610157] env[65478]: DEBUG oslo_vmware.api [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011834, 'name': RemoveSnapshot_Task, 'duration_secs': 1.165352} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  866.610376] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Deleted Snapshot of the VM instance {{(pid=65478) _delete_vm_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:938}}
[  866.610568] env[65478]: INFO nova.compute.manager [None req-39bd354e-5792-4d2e-806e-8645917f06ed tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Took 25.67 seconds to snapshot the instance on the hypervisor.
[  866.671926] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  866.672590] env[65478]: DEBUG oslo_vmware.service [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-ac1dbf23-334a-4954-a677-e12e1ff6c059 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  866.680998] env[65478]: DEBUG oslo_vmware.api [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Waiting for the task: (returnval){
[  866.680998] env[65478]:    value = "task-6011835"
[  866.680998] env[65478]:    _type = "Task"
[  866.680998] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  866.692389] env[65478]: DEBUG oslo_vmware.api [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011835, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  867.080656] env[65478]: DEBUG nova.compute.manager [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] [instance: 8d032b6f-86df-4397-8727-d4336f973368] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  867.194151] env[65478]: DEBUG oslo_vmware.api [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011835, 'name': PowerOnVM_Task, 'duration_secs': 0.399704} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  867.194393] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  867.194516] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0346c343-8426-4aea-ba35-54c1b22a40b8 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Updating instance '6f6c4cda-9439-47dd-810c-25b0516585e6' progress to 100 {{(pid=65478) _update_instance_progress /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1352}}
[  867.649183] env[65478]: DEBUG oslo_vmware.service [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-57289239-9dd3-498a-8e72-f44e41050e1f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  867.657350] env[65478]: DEBUG oslo_vmware.service [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-902cd7d3-ee3c-4404-a46c-69f86605eef1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  867.696669] env[65478]: DEBUG oslo_vmware.service [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9c1f1632-fc25-4b96-8a32-41725bd5ee9a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  867.708792] env[65478]: DEBUG oslo_vmware.service [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3664e3b0-cfb9-4588-97d0-730173edcc27 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  867.727314] env[65478]: DEBUG nova.compute.provider_tree [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  867.741062] env[65478]: DEBUG oslo_vmware.rw_handles [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Getting lease state for https://esx7c1n3.openstack.eu-de-1.cloud.sap/nfc/5223517f-6307-06d6-64e1-359774aec8ce/disk-0.vmdk. {{(pid=65478) _release_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:423}}
[  867.742666] env[65478]: DEBUG oslo_vmware.service [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0a93ebab-df5a-456d-878f-7e0cc33505c7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  867.749211] env[65478]: DEBUG oslo_vmware.rw_handles [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lease for https://esx7c1n3.openstack.eu-de-1.cloud.sap/nfc/5223517f-6307-06d6-64e1-359774aec8ce/disk-0.vmdk is in state: ready. {{(pid=65478) _release_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:430}}
[  867.749324] env[65478]: ERROR oslo_vmware.rw_handles [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Aborting lease for https://esx7c1n3.openstack.eu-de-1.cloud.sap/nfc/5223517f-6307-06d6-64e1-359774aec8ce/disk-0.vmdk due to incomplete transfer.
[  867.749839] env[65478]: DEBUG oslo_vmware.service [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking HttpNfcLease.HttpNfcLeaseAbort with opID=oslo.vmware-dbfb4ce3-f1cf-49ec-b164-7812debffab0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  867.761245] env[65478]: DEBUG oslo_vmware.rw_handles [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Closed VMDK read handle for https://esx7c1n3.openstack.eu-de-1.cloud.sap/nfc/5223517f-6307-06d6-64e1-359774aec8ce/disk-0.vmdk. {{(pid=65478) close /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:735}}
[  867.761466] env[65478]: DEBUG nova.virt.vmwareapi.images [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Uploaded image c9f40f18-b301-41ed-99ed-46614a14a522 to the Glance image server {{(pid=65478) upload_image_stream_optimized /opt/stack/nova/nova/virt/vmwareapi/images.py:472}}
[  867.763695] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Destroying the VM {{(pid=65478) destroy_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1368}}
[  867.764271] env[65478]: DEBUG oslo_vmware.service [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualMachine.Destroy_Task with opID=oslo.vmware-ab843a12-07bd-48b9-94f0-af2f1831b69f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  867.771160] env[65478]: DEBUG oslo_vmware.api [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  867.771160] env[65478]:    value = "task-6011836"
[  867.771160] env[65478]:    _type = "Task"
[  867.771160] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  867.782958] env[65478]: DEBUG oslo_vmware.api [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011836, 'name': Destroy_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  868.093306] env[65478]: DEBUG nova.compute.manager [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] [instance: 8d032b6f-86df-4397-8727-d4336f973368] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  868.115839] env[65478]: DEBUG nova.virt.hardware [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  868.116050] env[65478]: DEBUG nova.virt.hardware [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  868.116166] env[65478]: DEBUG nova.virt.hardware [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  868.116304] env[65478]: DEBUG nova.virt.hardware [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  868.116404] env[65478]: DEBUG nova.virt.hardware [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  868.116861] env[65478]: DEBUG nova.virt.hardware [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  868.116861] env[65478]: DEBUG nova.virt.hardware [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  868.116861] env[65478]: DEBUG nova.virt.hardware [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  868.116981] env[65478]: DEBUG nova.virt.hardware [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  868.117029] env[65478]: DEBUG nova.virt.hardware [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  868.118185] env[65478]: DEBUG nova.virt.hardware [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  868.118268] env[65478]: DEBUG oslo_vmware.service [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e4a3eea9-73c6-44a0-aba6-989e33d606c1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  868.125662] env[65478]: DEBUG oslo_vmware.service [None req-1915f893-8104-4e6b-aac7-4ee14dd27ab6 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-da4e84ca-ae2f-499f-9d4f-91fcea80da0b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  868.232251] env[65478]: DEBUG nova.scheduler.client.report [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  868.283493] env[65478]: DEBUG oslo_vmware.api [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011836, 'name': Destroy_Task, 'duration_secs': 0.344062} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  868.284049] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Destroyed the VM
[  868.284585] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Deleting Snapshot of the VM instance {{(pid=65478) _delete_vm_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:932}}
[  868.285472] env[65478]: DEBUG oslo_vmware.service [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualMachineSnapshot.RemoveSnapshot_Task with opID=oslo.vmware-da4fe981-6487-46e7-8b65-c39c81f03afa {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  868.291672] env[65478]: DEBUG oslo_vmware.api [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  868.291672] env[65478]:    value = "task-6011837"
[  868.291672] env[65478]:    _type = "Task"
[  868.291672] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  868.301217] env[65478]: DEBUG oslo_vmware.api [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011837, 'name': RemoveSnapshot_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  868.740684] env[65478]: DEBUG oslo_concurrency.lockutils [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.684s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  868.740991] env[65478]: DEBUG nova.compute.manager [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] [instance: e2e07720-a241-4382-a684-0835b199e37d] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  868.747292] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 26.940s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  868.747292] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  868.747292] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[  868.747292] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8bb8e9b7-3937-4dbf-a467-689c8c1b0c98 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  868.752709] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 19.407s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  868.754414] env[65478]: INFO nova.compute.claims [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] [instance: 28d4751c-5d09-422a-84b1-e82df32f6b4d] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  868.761732] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a21f18bc-f69a-4b97-aaae-70e57e6bb503 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  868.780310] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8e776e3a-f15e-42de-8117-651948301928 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  868.790866] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3b31d135-553f-48d9-b30f-9a8546619f55 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  868.811174] env[65478]: DEBUG oslo_vmware.api [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011837, 'name': RemoveSnapshot_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  868.836033] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=179928MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[  868.836158] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  869.246180] env[65478]: WARNING nova.utils [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] The MainProcess.default pool does not have free threads so the task <bound method ComputeManager._allocate_network_async of <nova.compute.manager.ComputeManager object at 0x73d94c2e6500>> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  869.247715] env[65478]: DEBUG nova.compute.utils [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  869.313230] env[65478]: DEBUG oslo_vmware.api [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011837, 'name': RemoveSnapshot_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  869.449620] env[65478]: DEBUG nova.compute.manager [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  869.450716] env[65478]: DEBUG oslo_vmware.service [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-95571e18-bc43-4668-8ecb-0395b531973e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  869.555645] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Acquiring lock "6f6c4cda-9439-47dd-810c-25b0516585e6" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  869.556431] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Lock "6f6c4cda-9439-47dd-810c-25b0516585e6" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  869.556810] env[65478]: DEBUG nova.compute.manager [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Going to confirm migration 1 {{(pid=65478) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5331}}
[  869.752310] env[65478]: DEBUG nova.compute.manager [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] [instance: e2e07720-a241-4382-a684-0835b199e37d] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  869.816539] env[65478]: DEBUG oslo_vmware.api [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011837, 'name': RemoveSnapshot_Task, 'duration_secs': 1.330908} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  869.818468] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Deleted Snapshot of the VM instance {{(pid=65478) _delete_vm_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:938}}
[  869.818468] env[65478]: INFO nova.compute.manager [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Took 23.13 seconds to snapshot the instance on the hypervisor.
[  869.961817] env[65478]: INFO nova.compute.manager [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] instance snapshotting
[  869.964479] env[65478]: DEBUG oslo_vmware.service [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f5846fe1-2183-43b7-ab0f-df88c786a87c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  869.970445] env[65478]: DEBUG oslo_concurrency.lockutils [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Acquiring lock "f0e88cef-300d-42a4-9cb6-843dc85da6a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  869.971288] env[65478]: DEBUG oslo_concurrency.lockutils [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Lock "f0e88cef-300d-42a4-9cb6-843dc85da6a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  869.976868] env[65478]: DEBUG oslo_concurrency.lockutils [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Acquiring lock "f0e88cef-300d-42a4-9cb6-843dc85da6a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  869.987236] env[65478]: DEBUG oslo_concurrency.lockutils [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Lock "f0e88cef-300d-42a4-9cb6-843dc85da6a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.010s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  869.989450] env[65478]: DEBUG oslo_concurrency.lockutils [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Lock "f0e88cef-300d-42a4-9cb6-843dc85da6a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  870.002634] env[65478]: DEBUG oslo_vmware.service [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-7c23f89c-3983-4986-81f1-8259e1884027 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  870.022023] env[65478]: INFO nova.compute.manager [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Terminating instance
[  870.066211] env[65478]: WARNING neutronclient.v2_0.client [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  870.158363] env[65478]: WARNING neutronclient.v2_0.client [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  870.158723] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Acquiring lock "refresh_cache-6f6c4cda-9439-47dd-810c-25b0516585e6" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  870.158811] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Acquired lock "refresh_cache-6f6c4cda-9439-47dd-810c-25b0516585e6" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  870.158958] env[65478]: DEBUG nova.network.neutron [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  870.159119] env[65478]: DEBUG nova.objects.instance [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Lazy-loading 'info_cache' on Instance uuid 6f6c4cda-9439-47dd-810c-25b0516585e6 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  870.382531] env[65478]: DEBUG nova.compute.manager [None req-ffef6f32-9b52-4591-9162-cdba1e601cf1 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Found 1 images (rotation: 2) {{(pid=65478) _rotate_backups /opt/stack/nova/nova/compute/manager.py:5098}}
[  870.431806] env[65478]: DEBUG oslo_vmware.service [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9b3d30e0-054a-4998-959b-f725af4d1868 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  870.440992] env[65478]: DEBUG oslo_vmware.service [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d7e00ae7-3cca-42c9-bad4-76756b4901f7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  870.475364] env[65478]: DEBUG oslo_vmware.service [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c66806d7-d06d-4849-8f17-1970cfe7906c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  870.483684] env[65478]: DEBUG oslo_vmware.service [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4b4f0e87-4d3d-44e0-b9d7-b0d8bb13a526 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  870.501240] env[65478]: DEBUG nova.compute.provider_tree [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  870.524820] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Creating Snapshot of the VM instance {{(pid=65478) _create_vm_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:913}}
[  870.525189] env[65478]: DEBUG oslo_vmware.service [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking VirtualMachine.CreateSnapshot_Task with opID=oslo.vmware-b2a5ac98-186e-446d-b7e2-e218675dd4f5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  870.530019] env[65478]: DEBUG nova.compute.manager [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[  870.530228] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  870.531624] env[65478]: DEBUG oslo_vmware.service [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b15219e1-6229-4749-bfb1-06a3030d8f14 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  870.536490] env[65478]: DEBUG oslo_vmware.api [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Waiting for the task: (returnval){
[  870.536490] env[65478]:    value = "task-6011838"
[  870.536490] env[65478]:    _type = "Task"
[  870.536490] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  870.543895] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  870.544551] env[65478]: DEBUG oslo_vmware.service [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-2a8ab987-9a2e-4d3e-9f9f-ab00f2ddd93b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  870.549440] env[65478]: DEBUG oslo_vmware.api [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011838, 'name': CreateSnapshot_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  870.554094] env[65478]: DEBUG oslo_vmware.api [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Waiting for the task: (returnval){
[  870.554094] env[65478]:    value = "task-6011839"
[  870.554094] env[65478]:    _type = "Task"
[  870.554094] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  870.562173] env[65478]: DEBUG oslo_vmware.api [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Task: {'id': task-6011839, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  870.762518] env[65478]: DEBUG nova.compute.manager [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] [instance: e2e07720-a241-4382-a684-0835b199e37d] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  870.794616] env[65478]: DEBUG nova.virt.hardware [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  870.794777] env[65478]: DEBUG nova.virt.hardware [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  870.794824] env[65478]: DEBUG nova.virt.hardware [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  870.794991] env[65478]: DEBUG nova.virt.hardware [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  870.795059] env[65478]: DEBUG nova.virt.hardware [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  870.795187] env[65478]: DEBUG nova.virt.hardware [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  870.795437] env[65478]: DEBUG nova.virt.hardware [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  870.795505] env[65478]: DEBUG nova.virt.hardware [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  870.795696] env[65478]: DEBUG nova.virt.hardware [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  870.795696] env[65478]: DEBUG nova.virt.hardware [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  870.795854] env[65478]: DEBUG nova.virt.hardware [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  870.800017] env[65478]: DEBUG oslo_vmware.service [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e950a89c-29ab-435f-b64c-bed431f48417 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  870.806749] env[65478]: DEBUG oslo_vmware.service [None req-44c8197b-7a2e-4a3e-a8c8-70d094e98848 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a8e7b49a-ce5f-4f7e-b3f4-25a603ba0dde {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  871.004222] env[65478]: DEBUG nova.scheduler.client.report [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  871.048134] env[65478]: DEBUG oslo_vmware.api [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011838, 'name': CreateSnapshot_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  871.071293] env[65478]: DEBUG oslo_vmware.api [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Task: {'id': task-6011839, 'name': PowerOffVM_Task, 'duration_secs': 0.172319} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  871.071589] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  871.072312] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  871.072765] env[65478]: DEBUG oslo_vmware.service [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-ba35d7d1-e68d-4049-8201-34295d5884f5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  871.143349] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  871.143524] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Deleting contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  871.143758] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Deleting the datastore file [datastore1] f0e88cef-300d-42a4-9cb6-843dc85da6a3 {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  871.144140] env[65478]: DEBUG oslo_vmware.service [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-66af26d0-fd26-4b11-96dc-14ab02977f42 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  871.152280] env[65478]: DEBUG oslo_vmware.api [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Waiting for the task: (returnval){
[  871.152280] env[65478]:    value = "task-6011841"
[  871.152280] env[65478]:    _type = "Task"
[  871.152280] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  871.161669] env[65478]: DEBUG oslo_vmware.api [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Task: {'id': task-6011841, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  871.167552] env[65478]: WARNING neutronclient.v2_0.client [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  871.390489] env[65478]: WARNING neutronclient.v2_0.client [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  871.469725] env[65478]: DEBUG nova.network.neutron [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Updating instance_info_cache with network_info: [{"id": "0c0d9e92-abc5-4d72-881a-e5bca5e8ff47", "address": "fa:16:3e:08:d3:02", "network": {"id": "8419dcc5-ccb7-4667-a5ee-3f07016ddecd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "eb20b7ec77e847179c9940510a8b48bf", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "ec3f9e71-839a-429d-b211-d3dfc98ca4f6", "external-id": "nsx-vlan-transportzone-5", "segmentation_id": 5, "bound_drivers": {"0": "nsxv3"}}, "devname": "tap0c0d9e92-ab", "ovs_interfaceid": "0c0d9e92-abc5-4d72-881a-e5bca5e8ff47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  871.511444] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.763s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  871.511444] env[65478]: DEBUG oslo_concurrency.lockutils [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 13.629s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  871.512202] env[65478]: DEBUG nova.compute.manager [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] [instance: 28d4751c-5d09-422a-84b1-e82df32f6b4d] Start building networks asynchronously for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}}
[  871.515338] env[65478]: DEBUG nova.objects.instance [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Lazy-loading 'resources' on Instance uuid 28200981-9217-4395-b0a8-c154624c7a1c {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  871.548727] env[65478]: DEBUG oslo_vmware.api [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011838, 'name': CreateSnapshot_Task, 'duration_secs': 0.673975} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  871.549168] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Created Snapshot of the VM instance {{(pid=65478) _create_vm_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:922}}
[  871.550078] env[65478]: DEBUG oslo_vmware.service [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-613319e4-eeac-49e6-b3da-e067b97e2f99 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  871.662028] env[65478]: DEBUG oslo_vmware.api [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Task: {'id': task-6011841, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.16352} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  871.662872] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  871.662872] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Deleted contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  871.662872] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  871.662872] env[65478]: INFO nova.compute.manager [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Took 1.13 seconds to destroy the instance on the hypervisor.
[  871.665043] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  871.666110] env[65478]: DEBUG nova.compute.manager [-] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[  871.666110] env[65478]: DEBUG nova.network.neutron [-] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[  871.666110] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  871.679521] env[65478]: WARNING nova.utils [None req-f18fd78e-de89-49de-abc2-f05cd5e700cc tempest-ServerPasswordTestJSON-1188897136 tempest-ServerPasswordTestJSON-1188897136-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d9384b88b0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  871.718546] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  871.954091] env[65478]: DEBUG nova.compute.manager [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  871.955745] env[65478]: DEBUG oslo_vmware.service [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-54e54259-37d0-445d-82a1-5899db3e273c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  871.972688] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Releasing lock "refresh_cache-6f6c4cda-9439-47dd-810c-25b0516585e6" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  871.972688] env[65478]: DEBUG nova.objects.instance [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Lazy-loading 'migration_context' on Instance uuid 6f6c4cda-9439-47dd-810c-25b0516585e6 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  872.019746] env[65478]: WARNING nova.utils [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] The MainProcess.default pool does not have free threads so the task <bound method ComputeManager._allocate_network_async of <nova.compute.manager.ComputeManager object at 0x73d94c2e6500>> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  872.020237] env[65478]: DEBUG nova.compute.utils [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Using /dev/sd instead of None {{(pid=65478) get_next_device_name /opt/stack/nova/nova/compute/utils.py:239}}
[  872.076090] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Creating linked-clone VM from snapshot {{(pid=65478) _create_linked_clone_from_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:955}}
[  872.078495] env[65478]: DEBUG oslo_vmware.service [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking VirtualMachine.CloneVM_Task with opID=oslo.vmware-d17fb3b5-091f-423c-b5b5-f95f20dd7e36 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  872.089377] env[65478]: DEBUG oslo_vmware.api [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Waiting for the task: (returnval){
[  872.089377] env[65478]:    value = "task-6011842"
[  872.089377] env[65478]:    _type = "Task"
[  872.089377] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  872.099137] env[65478]: DEBUG oslo_vmware.api [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011842, 'name': CloneVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  872.375377] env[65478]: DEBUG nova.compute.manager [req-9ef44051-964c-4b18-85f7-b6b9731b4925 req-5bb34507-df33-459c-b017-22855db874e7 service nova] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Received event network-vif-deleted-fb55a6bb-2879-44ea-b228-fe4609c36e10 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  872.376454] env[65478]: INFO nova.compute.manager [req-9ef44051-964c-4b18-85f7-b6b9731b4925 req-5bb34507-df33-459c-b017-22855db874e7 service nova] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Neutron deleted interface fb55a6bb-2879-44ea-b228-fe4609c36e10; detaching it from the instance and deleting it from the info cache
[  872.378993] env[65478]: DEBUG nova.network.neutron [req-9ef44051-964c-4b18-85f7-b6b9731b4925 req-5bb34507-df33-459c-b017-22855db874e7 service nova] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  872.469981] env[65478]: INFO nova.compute.manager [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] instance snapshotting
[  872.470955] env[65478]: DEBUG nova.objects.instance [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lazy-loading 'flavor' on Instance uuid 9b286a00-af27-4012-a596-45bbe98da254 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  872.474688] env[65478]: DEBUG nova.objects.base [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Object Instance<6f6c4cda-9439-47dd-810c-25b0516585e6> lazy-loaded attributes: info_cache,migration_context {{(pid=65478) wrapper /opt/stack/nova/nova/objects/base.py:136}}
[  872.475737] env[65478]: DEBUG oslo_vmware.service [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6bc2d7b4-0ea3-47cd-ae60-50d0ba92fdca {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  872.520253] env[65478]: DEBUG oslo_vmware.service [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-075bdcb4-666d-4bbb-9a8b-1d494b819d83 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  872.527097] env[65478]: DEBUG nova.compute.manager [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] [instance: 28d4751c-5d09-422a-84b1-e82df32f6b4d] Start building block device mappings for instance. {{(pid=65478) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}}
[  872.532819] env[65478]: DEBUG oslo_vmware.api [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Waiting for the task: (returnval){
[  872.532819] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]525ffb7b-11a4-6450-de15-fd8f798dcae6"
[  872.532819] env[65478]:    _type = "Task"
[  872.532819] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  872.546029] env[65478]: DEBUG oslo_vmware.api [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]525ffb7b-11a4-6450-de15-fd8f798dcae6, 'name': SearchDatastore_Task, 'duration_secs': 0.007269} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  872.549569] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  872.603027] env[65478]: DEBUG oslo_vmware.api [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011842, 'name': CloneVM_Task} progress is 94%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  872.764692] env[65478]: DEBUG oslo_vmware.service [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d02ad165-38ed-467f-a7af-8f9378474ce0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  872.777034] env[65478]: DEBUG oslo_vmware.service [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-54ccb669-a08d-43e4-936f-f2feae640fa4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  872.817787] env[65478]: DEBUG oslo_vmware.service [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-5deeb3c6-1000-4725-be79-bea9dd62f0af {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  872.825578] env[65478]: DEBUG oslo_vmware.service [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-5d7a8510-b76e-4ba5-98ca-49e0df1f53e9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  872.844458] env[65478]: DEBUG nova.compute.provider_tree [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  872.845380] env[65478]: DEBUG nova.network.neutron [-] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  872.885813] env[65478]: DEBUG oslo_vmware.service [req-9ef44051-964c-4b18-85f7-b6b9731b4925 req-5bb34507-df33-459c-b017-22855db874e7 service nova] Invoking SearchIndex.FindAllByUuid with opID=oslo.vmware-ab8eb6bd-e652-4cb3-af11-1a43d4c3b050 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  872.894433] env[65478]: DEBUG oslo_vmware.service [req-9ef44051-964c-4b18-85f7-b6b9731b4925 req-5bb34507-df33-459c-b017-22855db874e7 service nova] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-194d8d69-325b-4baa-86e4-1b45b4a0bb97 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  872.943071] env[65478]: DEBUG nova.compute.manager [req-9ef44051-964c-4b18-85f7-b6b9731b4925 req-5bb34507-df33-459c-b017-22855db874e7 service nova] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Detach interface failed, port_id=fb55a6bb-2879-44ea-b228-fe4609c36e10, reason: Instance f0e88cef-300d-42a4-9cb6-843dc85da6a3 could not be found. {{(pid=65478) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}}
[  872.978786] env[65478]: DEBUG oslo_vmware.service [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c4e13c77-34f9-40d4-b8fb-9ae642ca7ed1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  873.000054] env[65478]: DEBUG oslo_vmware.service [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8021ebc8-18c1-411b-9eb7-23869b1231a4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  873.099138] env[65478]: DEBUG oslo_vmware.api [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011842, 'name': CloneVM_Task} progress is 94%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  873.349188] env[65478]: DEBUG nova.scheduler.client.report [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  873.353385] env[65478]: INFO nova.compute.manager [-] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Took 1.69 seconds to deallocate network for instance.
[  873.510717] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Creating Snapshot of the VM instance {{(pid=65478) _create_vm_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:913}}
[  873.511056] env[65478]: DEBUG oslo_vmware.service [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualMachine.CreateSnapshot_Task with opID=oslo.vmware-947251ba-f6a2-48bd-9888-cb43f293d1fa {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  873.518813] env[65478]: DEBUG oslo_vmware.api [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  873.518813] env[65478]:    value = "task-6011843"
[  873.518813] env[65478]:    _type = "Task"
[  873.518813] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  873.528171] env[65478]: DEBUG oslo_vmware.api [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011843, 'name': CreateSnapshot_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  873.546192] env[65478]: DEBUG nova.compute.manager [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] [instance: 28d4751c-5d09-422a-84b1-e82df32f6b4d] Start spawning the instance on the hypervisor. {{(pid=65478) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}}
[  873.567926] env[65478]: DEBUG nova.virt.hardware [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  873.568131] env[65478]: DEBUG nova.virt.hardware [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  873.568244] env[65478]: DEBUG nova.virt.hardware [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  873.568379] env[65478]: DEBUG nova.virt.hardware [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  873.570080] env[65478]: DEBUG nova.virt.hardware [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  873.570080] env[65478]: DEBUG nova.virt.hardware [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  873.570080] env[65478]: DEBUG nova.virt.hardware [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  873.570080] env[65478]: DEBUG nova.virt.hardware [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  873.570080] env[65478]: DEBUG nova.virt.hardware [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  873.570298] env[65478]: DEBUG nova.virt.hardware [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  873.570298] env[65478]: DEBUG nova.virt.hardware [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  873.570298] env[65478]: DEBUG oslo_vmware.service [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f88c546a-763a-4e2b-b00d-79339ffdf9b2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  873.578114] env[65478]: DEBUG oslo_vmware.service [None req-7cb76abc-ebfb-42d2-9f5a-26e23f8ae3ea tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0da1fa90-3231-42f2-aaa4-482c4b529c39 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  873.601852] env[65478]: DEBUG oslo_vmware.api [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011842, 'name': CloneVM_Task} progress is 94%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  873.856721] env[65478]: DEBUG oslo_concurrency.lockutils [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.347s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  873.860479] env[65478]: DEBUG oslo_concurrency.lockutils [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 15.015s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  873.860827] env[65478]: DEBUG oslo_concurrency.lockutils [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  873.861208] env[65478]: DEBUG nova.objects.instance [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Lazy-loading 'resources' on Instance uuid 98b2d40a-0c59-4540-b60e-17e5206dea42 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  873.887225] env[65478]: INFO nova.scheduler.client.report [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Deleted allocations for instance 28200981-9217-4395-b0a8-c154624c7a1c
[  874.029969] env[65478]: DEBUG oslo_vmware.api [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011843, 'name': CreateSnapshot_Task} progress is 100%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  874.103144] env[65478]: DEBUG oslo_vmware.api [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011842, 'name': CloneVM_Task, 'duration_secs': 1.791142} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  874.103356] env[65478]: INFO nova.virt.vmwareapi.vmops [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Created linked-clone VM from snapshot
[  874.104213] env[65478]: DEBUG oslo_vmware.service [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c38b9323-5b85-493e-a56c-c73a6859476c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  874.111645] env[65478]: DEBUG nova.virt.vmwareapi.images [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Uploading image 782a4764-0964-46af-bc98-c22388b9ef87 {{(pid=65478) upload_image_stream_optimized /opt/stack/nova/nova/virt/vmwareapi/images.py:441}}
[  874.133026] env[65478]: DEBUG oslo_vmware.rw_handles [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Creating HttpNfcLease lease for exporting VM: (result){
[  874.133026] env[65478]:    value = "vm-1161297"
[  874.133026] env[65478]:    _type = "VirtualMachine"
[  874.133026] env[65478]:  }. {{(pid=65478) _create_export_vm_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:478}}
[  874.133338] env[65478]: DEBUG oslo_vmware.service [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking VirtualMachine.ExportVm with opID=oslo.vmware-b309fdd4-61cf-4142-be0d-c2153a27aa03 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  874.139134] env[65478]: DEBUG oslo_vmware.rw_handles [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Lease: (returnval){
[  874.139134] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]529f97f7-dce6-50aa-b1ed-643e232c0d9d"
[  874.139134] env[65478]:    _type = "HttpNfcLease"
[  874.139134] env[65478]:  } obtained for exporting VM: (result){
[  874.139134] env[65478]:    value = "vm-1161297"
[  874.139134] env[65478]:    _type = "VirtualMachine"
[  874.139134] env[65478]:  }. {{(pid=65478) _create_export_vm_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:481}}
[  874.139412] env[65478]: DEBUG oslo_vmware.api [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Waiting for the lease: (returnval){
[  874.139412] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]529f97f7-dce6-50aa-b1ed-643e232c0d9d"
[  874.139412] env[65478]:    _type = "HttpNfcLease"
[  874.139412] env[65478]:  } to be ready. {{(pid=65478) wait_for_lease_ready /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:462}}
[  874.146184] env[65478]: DEBUG oslo_vmware.api [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Lease: (returnval){
[  874.146184] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]529f97f7-dce6-50aa-b1ed-643e232c0d9d"
[  874.146184] env[65478]:    _type = "HttpNfcLease"
[  874.146184] env[65478]:  } is initializing. {{(pid=65478) _poll_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:490}}
[  874.398172] env[65478]: DEBUG oslo_concurrency.lockutils [None req-eb518a97-1047-4938-986e-7fe91c355ac8 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] Lock "28200981-9217-4395-b0a8-c154624c7a1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 22.266s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  874.540321] env[65478]: DEBUG oslo_vmware.api [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011843, 'name': CreateSnapshot_Task, 'duration_secs': 0.534184} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  874.541304] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Created Snapshot of the VM instance {{(pid=65478) _create_vm_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:922}}
[  874.542441] env[65478]: DEBUG oslo_vmware.service [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d0f63178-2930-44ec-b9a9-3d346b0c8775 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  874.648565] env[65478]: DEBUG oslo_vmware.api [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Lease: (returnval){
[  874.648565] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]529f97f7-dce6-50aa-b1ed-643e232c0d9d"
[  874.648565] env[65478]:    _type = "HttpNfcLease"
[  874.648565] env[65478]:  } is ready. {{(pid=65478) _poll_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:487}}
[  874.648942] env[65478]: DEBUG oslo_vmware.rw_handles [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking VIM API for reading info of lease: (returnval){
[  874.648942] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]529f97f7-dce6-50aa-b1ed-643e232c0d9d"
[  874.648942] env[65478]:    _type = "HttpNfcLease"
[  874.648942] env[65478]:  }. {{(pid=65478) _create_export_vm_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:486}}
[  874.651651] env[65478]: DEBUG oslo_vmware.service [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9b501a18-fe02-4ac6-9694-53e37302fc88 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  874.660176] env[65478]: DEBUG oslo_vmware.rw_handles [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Found VMDK URL: https://esx7c1n1.openstack.eu-de-1.cloud.sap/nfc/529b9c6c-afb2-e3ea-f9b8-cbd11f31a69f/disk-0.vmdk from lease info. {{(pid=65478) _find_vmdk_url /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:531}}
[  874.660423] env[65478]: DEBUG oslo_vmware.rw_handles [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Opening URL: https://esx7c1n1.openstack.eu-de-1.cloud.sap/nfc/529b9c6c-afb2-e3ea-f9b8-cbd11f31a69f/disk-0.vmdk for reading. {{(pid=65478) _create_read_connection /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:99}}
[  874.779108] env[65478]: DEBUG oslo_vmware.service [-] Invoking HttpNfcLease.HttpNfcLeaseProgress with opID=oslo.vmware-4d41d37c-82bb-46f9-9e92-f601276af2b9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  874.787398] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'oslo_vmware.rw_handles.VmdkHandle.update_progress' sleeping for 59.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[  874.892537] env[65478]: DEBUG oslo_vmware.service [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-48d017bf-125b-4c48-bded-d8c162cdbdac {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  874.899639] env[65478]: DEBUG oslo_vmware.service [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-11f86352-fd9d-489a-b48b-5f513ff84847 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  874.935154] env[65478]: DEBUG oslo_vmware.service [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-2887eb09-1289-470e-af95-2db77df8d74a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  874.945630] env[65478]: DEBUG oslo_vmware.service [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d0f54265-3a92-4ce7-b270-ea18e08f9c90 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  874.966435] env[65478]: DEBUG nova.compute.provider_tree [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  875.063382] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Creating linked-clone VM from snapshot {{(pid=65478) _create_linked_clone_from_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:955}}
[  875.063737] env[65478]: DEBUG oslo_vmware.service [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualMachine.CloneVM_Task with opID=oslo.vmware-38c884f2-c4ef-4c4b-b8c7-523bda51f6f4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  875.073125] env[65478]: DEBUG oslo_vmware.api [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  875.073125] env[65478]:    value = "task-6011845"
[  875.073125] env[65478]:    _type = "Task"
[  875.073125] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  875.082078] env[65478]: DEBUG oslo_vmware.api [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011845, 'name': CloneVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  875.470115] env[65478]: DEBUG nova.scheduler.client.report [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  875.584690] env[65478]: DEBUG oslo_vmware.api [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011845, 'name': CloneVM_Task} progress is 94%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  875.682715] env[65478]: WARNING nova.utils [None req-a1708889-7c4e-4c0b-a184-248b215ad478 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d9381a5d80> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  875.975863] env[65478]: DEBUG oslo_concurrency.lockutils [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.119s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  875.977882] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 7.142s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  876.019459] env[65478]: INFO nova.scheduler.client.report [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Deleted allocations for instance 98b2d40a-0c59-4540-b60e-17e5206dea42
[  876.085277] env[65478]: DEBUG oslo_vmware.api [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011845, 'name': CloneVM_Task} progress is 94%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  876.528358] env[65478]: DEBUG oslo_concurrency.lockutils [None req-52d734fd-b004-47b7-97d2-20413e5052ed tempest-VolumesAssistedSnapshotsTest-1943731308 tempest-VolumesAssistedSnapshotsTest-1943731308-project-member] Lock "98b2d40a-0c59-4540-b60e-17e5206dea42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 21.980s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  876.587595] env[65478]: DEBUG oslo_vmware.api [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011845, 'name': CloneVM_Task} progress is 100%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  876.992978] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Applying migration context for instance 6f6c4cda-9439-47dd-810c-25b0516585e6 as it has an incoming, in-progress migration f558a7ca-024a-4401-b9e1-cfa6bff8bb87. Migration status is confirming {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
[  876.996036] env[65478]: INFO nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Updating resource usage from migration f558a7ca-024a-4401-b9e1-cfa6bff8bb87
[  877.025432] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 78246782-d2a2-4819-8924-51764ffe05aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  877.025600] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e4810749-aefd-411e-87c1-5b1b1967538f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  877.025739] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d978e71d-2c30-4a76-b000-6ddf3203ab10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  877.025847] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance db37d828-c474-4577-816b-6fb2fcd9a82b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  877.025950] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance c0545749-bc03-4f28-a0d4-ebaf55049095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  877.026063] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 9b286a00-af27-4012-a596-45bbe98da254 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  877.026221] env[65478]: WARNING nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance f0e88cef-300d-42a4-9cb6-843dc85da6a3 is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do.
[  877.026450] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance fbf21f21-d370-4a6a-ae24-0e6840464e24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  877.026450] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance f37353fc-a5c5-41db-9d2c-c1f286fe321b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  877.026554] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e9f84a20-8def-4f36-92eb-8625364f7024 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  877.026645] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ef569806-5f50-44b9-a4a9-0107328a8dfe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 2, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  877.026743] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  877.026848] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  877.026986] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  877.027097] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  877.027207] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  877.027305] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Migration f558a7ca-024a-4401-b9e1-cfa6bff8bb87 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
[  877.027412] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  877.027507] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 6f6c4cda-9439-47dd-810c-25b0516585e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  877.027663] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  877.027781] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  877.027876] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  877.027970] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  877.085733] env[65478]: DEBUG oslo_vmware.api [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011845, 'name': CloneVM_Task, 'duration_secs': 1.570722} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  877.086410] env[65478]: INFO nova.virt.vmwareapi.vmops [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Created linked-clone VM from snapshot
[  877.087909] env[65478]: DEBUG oslo_vmware.service [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f9157d4e-765b-497a-98ee-ae0b922a574c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  877.096346] env[65478]: DEBUG nova.virt.vmwareapi.images [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Uploading image c8c39da2-6a16-4dab-9d90-ba211440ae15 {{(pid=65478) upload_image_stream_optimized /opt/stack/nova/nova/virt/vmwareapi/images.py:441}}
[  877.121155] env[65478]: DEBUG oslo_vmware.rw_handles [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Creating HttpNfcLease lease for exporting VM: (result){
[  877.121155] env[65478]:    value = "vm-1161299"
[  877.121155] env[65478]:    _type = "VirtualMachine"
[  877.121155] env[65478]:  }. {{(pid=65478) _create_export_vm_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:478}}
[  877.121458] env[65478]: DEBUG oslo_vmware.service [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualMachine.ExportVm with opID=oslo.vmware-92bf4701-f9ab-46fb-9d5d-f7d01cce0215 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  877.128650] env[65478]: DEBUG oslo_vmware.rw_handles [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lease: (returnval){
[  877.128650] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]525ceef2-8ec1-e2b4-1a64-48225b47f16e"
[  877.128650] env[65478]:    _type = "HttpNfcLease"
[  877.128650] env[65478]:  } obtained for exporting VM: (result){
[  877.128650] env[65478]:    value = "vm-1161299"
[  877.128650] env[65478]:    _type = "VirtualMachine"
[  877.128650] env[65478]:  }. {{(pid=65478) _create_export_vm_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:481}}
[  877.129209] env[65478]: DEBUG oslo_vmware.api [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the lease: (returnval){
[  877.129209] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]525ceef2-8ec1-e2b4-1a64-48225b47f16e"
[  877.129209] env[65478]:    _type = "HttpNfcLease"
[  877.129209] env[65478]:  } to be ready. {{(pid=65478) wait_for_lease_ready /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:462}}
[  877.136329] env[65478]: DEBUG oslo_vmware.api [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lease: (returnval){
[  877.136329] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]525ceef2-8ec1-e2b4-1a64-48225b47f16e"
[  877.136329] env[65478]:    _type = "HttpNfcLease"
[  877.136329] env[65478]:  } is initializing. {{(pid=65478) _poll_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:490}}
[  877.531898] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 5fc40115-fc0a-4401-9083-5bc33290e8c4 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  877.638848] env[65478]: DEBUG oslo_vmware.api [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lease: (returnval){
[  877.638848] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]525ceef2-8ec1-e2b4-1a64-48225b47f16e"
[  877.638848] env[65478]:    _type = "HttpNfcLease"
[  877.638848] env[65478]:  } is ready. {{(pid=65478) _poll_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:487}}
[  877.638848] env[65478]: DEBUG oslo_vmware.rw_handles [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VIM API for reading info of lease: (returnval){
[  877.638848] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]525ceef2-8ec1-e2b4-1a64-48225b47f16e"
[  877.638848] env[65478]:    _type = "HttpNfcLease"
[  877.638848] env[65478]:  }. {{(pid=65478) _create_export_vm_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:486}}
[  877.638848] env[65478]: DEBUG oslo_vmware.service [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-eced54ee-cb50-4dd8-957c-81144c00db11 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  877.647745] env[65478]: DEBUG oslo_vmware.rw_handles [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Found VMDK URL: https://esx7c1n3.openstack.eu-de-1.cloud.sap/nfc/523cab81-a556-d124-4a06-d0d233c30830/disk-0.vmdk from lease info. {{(pid=65478) _find_vmdk_url /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:531}}
[  877.648401] env[65478]: DEBUG oslo_vmware.rw_handles [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Opening URL: https://esx7c1n3.openstack.eu-de-1.cloud.sap/nfc/523cab81-a556-d124-4a06-d0d233c30830/disk-0.vmdk for reading. {{(pid=65478) _create_read_connection /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:99}}
[  877.755434] env[65478]: DEBUG oslo_vmware.service [-] Invoking HttpNfcLease.HttpNfcLeaseProgress with opID=oslo.vmware-47539286-ed5f-4169-9206-ad50df3df182 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  877.759808] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'oslo_vmware.rw_handles.VmdkHandle.update_progress' sleeping for 59.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[  878.034912] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 932f3bea-bf9d-441a-bcdb-71f852c523a9 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  878.537976] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 566cb5a1-5b9f-485d-9a00-ad38858e0b8e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  879.040936] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 560ca9f0-3db2-496c-8024-03859950f4ee has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  879.544971] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance a5f42a18-2651-4205-92a9-f4f6d7311071 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  880.048919] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 38551259-1e20-4db6-baae-981d16134ff0 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  880.552351] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 6d37dc97-5130-4be4-a7c1-bf304611e810 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  881.057825] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 2bbba546-6e53-4822-bcc7-45ed3d530f40 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  881.562719] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 36018dbd-f4b1-4740-a7bb-e96e5c174be0 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  881.983171] env[65478]: DEBUG nova.objects.instance [None req-21f3adec-bf06-4a37-976e-15340d27ae0d tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Lazy-loading 'flavor' on Instance uuid d978e71d-2c30-4a76-b000-6ddf3203ab10 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  882.066854] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance c8ba7da3-c9c5-4dbc-ad17-ca9d977a9adb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  882.490059] env[65478]: DEBUG oslo_concurrency.lockutils [None req-21f3adec-bf06-4a37-976e-15340d27ae0d tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Acquiring lock "refresh_cache-d978e71d-2c30-4a76-b000-6ddf3203ab10" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  882.490334] env[65478]: DEBUG oslo_concurrency.lockutils [None req-21f3adec-bf06-4a37-976e-15340d27ae0d tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Acquired lock "refresh_cache-d978e71d-2c30-4a76-b000-6ddf3203ab10" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  882.490597] env[65478]: WARNING neutronclient.v2_0.client [None req-21f3adec-bf06-4a37-976e-15340d27ae0d tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  882.571899] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance a2b3619c-81d9-4788-b745-b541a0678c19 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  882.677553] env[65478]: DEBUG oslo_vmware.rw_handles [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Getting lease state for https://esx7c1n1.openstack.eu-de-1.cloud.sap/nfc/529b9c6c-afb2-e3ea-f9b8-cbd11f31a69f/disk-0.vmdk. {{(pid=65478) _release_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:423}}
[  882.678529] env[65478]: DEBUG oslo_vmware.service [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-64afa924-ec41-4897-b099-9d934b9ddfb0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  882.685592] env[65478]: DEBUG oslo_vmware.rw_handles [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Lease for https://esx7c1n1.openstack.eu-de-1.cloud.sap/nfc/529b9c6c-afb2-e3ea-f9b8-cbd11f31a69f/disk-0.vmdk is in state: ready. {{(pid=65478) _release_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:430}}
[  882.685833] env[65478]: ERROR oslo_vmware.rw_handles [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Aborting lease for https://esx7c1n1.openstack.eu-de-1.cloud.sap/nfc/529b9c6c-afb2-e3ea-f9b8-cbd11f31a69f/disk-0.vmdk due to incomplete transfer.
[  882.686863] env[65478]: DEBUG oslo_vmware.service [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking HttpNfcLease.HttpNfcLeaseAbort with opID=oslo.vmware-affaf5e3-7774-4d8a-83a9-1d30c58a0259 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  882.696229] env[65478]: DEBUG oslo_vmware.rw_handles [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Closed VMDK read handle for https://esx7c1n1.openstack.eu-de-1.cloud.sap/nfc/529b9c6c-afb2-e3ea-f9b8-cbd11f31a69f/disk-0.vmdk. {{(pid=65478) close /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:735}}
[  882.696390] env[65478]: DEBUG nova.virt.vmwareapi.images [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Uploaded image 782a4764-0964-46af-bc98-c22388b9ef87 to the Glance image server {{(pid=65478) upload_image_stream_optimized /opt/stack/nova/nova/virt/vmwareapi/images.py:472}}
[  882.697645] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Destroying the VM {{(pid=65478) destroy_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1368}}
[  882.697940] env[65478]: DEBUG oslo_vmware.service [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking VirtualMachine.Destroy_Task with opID=oslo.vmware-b999f52c-374d-489f-8f25-34a3526eb2ad {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  882.706389] env[65478]: DEBUG oslo_vmware.api [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Waiting for the task: (returnval){
[  882.706389] env[65478]:    value = "task-6011847"
[  882.706389] env[65478]:    _type = "Task"
[  882.706389] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  882.717708] env[65478]: DEBUG oslo_vmware.api [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011847, 'name': Destroy_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  883.078557] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 1b7bac20-84c0-4b19-b759-b75e84c7abee has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  883.078978] env[65478]: DEBUG nova.network.neutron [None req-21f3adec-bf06-4a37-976e-15340d27ae0d tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  883.219096] env[65478]: DEBUG oslo_vmware.api [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011847, 'name': Destroy_Task, 'duration_secs': 0.376055} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  883.219341] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Destroyed the VM
[  883.219622] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Deleting Snapshot of the VM instance {{(pid=65478) _delete_vm_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:932}}
[  883.220521] env[65478]: DEBUG oslo_vmware.service [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking VirtualMachineSnapshot.RemoveSnapshot_Task with opID=oslo.vmware-7e155574-4431-4416-9e0f-a6903d895887 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  883.228681] env[65478]: DEBUG oslo_vmware.api [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Waiting for the task: (returnval){
[  883.228681] env[65478]:    value = "task-6011848"
[  883.228681] env[65478]:    _type = "Task"
[  883.228681] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  883.241577] env[65478]: DEBUG oslo_vmware.api [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011848, 'name': RemoveSnapshot_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  883.317410] env[65478]: DEBUG nova.compute.manager [req-9f7ca2e4-449e-41d1-ac86-e4b556e5c28f req-feda8344-d5c3-4323-812e-a6fe0a5e5f6a service nova] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Received event network-changed-a4636485-7b6f-4fbb-ab94-d4f75ada7a1c {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  883.318152] env[65478]: DEBUG nova.compute.manager [req-9f7ca2e4-449e-41d1-ac86-e4b556e5c28f req-feda8344-d5c3-4323-812e-a6fe0a5e5f6a service nova] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Refreshing instance network info cache due to event network-changed-a4636485-7b6f-4fbb-ab94-d4f75ada7a1c. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  883.318152] env[65478]: DEBUG oslo_concurrency.lockutils [req-9f7ca2e4-449e-41d1-ac86-e4b556e5c28f req-feda8344-d5c3-4323-812e-a6fe0a5e5f6a service nova] Acquiring lock "refresh_cache-d978e71d-2c30-4a76-b000-6ddf3203ab10" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  883.583797] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 26c4f07f-f4de-46b1-a462-b8cf13da075e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  883.584605] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 22 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[  883.584915] env[65478]: WARNING neutronclient.v2_0.client [None req-21f3adec-bf06-4a37-976e-15340d27ae0d tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  883.587201] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=4864MB phys_disk=100GB used_disk=23GB total_vcpus=48 used_vcpus=22 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '21', 'num_vm_active': '10', 'num_task_None': '9', 'num_os_type_None': '21', 'num_proj_81a0ae95d73f4678b203b7db9a0d36a7': '1', 'io_workload': '10', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '2', 'num_proj_1f872aa3128c4866aed16d152b15486f': '1', 'num_proj_a8a09b6e5ab3418e871f2d26fcd10a07': '3', 'num_task_image_uploading': '2', 'num_proj_3c6c9b0fcb1f453a8108522a8924bda3': '1', 'num_vm_resized': '1', 'num_proj_9f34d9b19c94478089fed931e391dfb7': '1', 'num_proj_d3e75bb33e1d4885a2a67dfd4c11409a': '1', 'num_proj_f871a0b5d01940f3aac47d33c49fc4b3': '1', 'num_proj_70efc035843c47d69ec6a42f446a2b91': '1', 'num_vm_building': '10', 'num_task_spawning': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[  883.740267] env[65478]: DEBUG oslo_vmware.api [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011848, 'name': RemoveSnapshot_Task} progress is 73%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  883.853146] env[65478]: WARNING neutronclient.v2_0.client [None req-21f3adec-bf06-4a37-976e-15340d27ae0d tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  883.936625] env[65478]: DEBUG nova.network.neutron [None req-21f3adec-bf06-4a37-976e-15340d27ae0d tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Updating instance_info_cache with network_info: [{"id": "a4636485-7b6f-4fbb-ab94-d4f75ada7a1c", "address": "fa:16:3e:bc:0f:ab", "network": {"id": "432219d2-eada-4b7b-82da-1951de930922", "bridge": "br-int", "label": "tempest-AttachInterfacesUnderV243Test-1661348426-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "10.180.180.155", "type": "floating", "version": 4, "meta": {}}]}, {"address": "192.168.128.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "1f872aa3128c4866aed16d152b15486f", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "8b1a0b17-d008-4a8b-be2a-796ff1a9a2d1", "external-id": "nsx-vlan-transportzone-880", "segmentation_id": 880, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapa4636485-7b", "ovs_interfaceid": "a4636485-7b6f-4fbb-ab94-d4f75ada7a1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  884.176371] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-730078cf-0b7c-4395-9247-09a8fdc51314 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  884.184106] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-440aeb91-9058-465f-ad5c-cde6960faf9c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  884.218303] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f3d82523-26d0-4c0e-8e14-d5ac2904dbed {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  884.226351] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-17fc3692-f2da-4fa3-ab83-20ee9f3dc59d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  884.248670] env[65478]: DEBUG oslo_vmware.api [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011848, 'name': RemoveSnapshot_Task, 'duration_secs': 0.591305} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  884.253263] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Deleted Snapshot of the VM instance {{(pid=65478) _delete_vm_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:938}}
[  884.253263] env[65478]: INFO nova.compute.manager [None req-40a1b74a-f979-4250-84cb-d3e46ffe2a17 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Took 14.29 seconds to snapshot the instance on the hypervisor.
[  884.255036] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  884.440839] env[65478]: DEBUG oslo_concurrency.lockutils [None req-21f3adec-bf06-4a37-976e-15340d27ae0d tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Releasing lock "refresh_cache-d978e71d-2c30-4a76-b000-6ddf3203ab10" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  884.440839] env[65478]: DEBUG nova.compute.manager [None req-21f3adec-bf06-4a37-976e-15340d27ae0d tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Inject network info {{(pid=65478) _inject_network_info /opt/stack/nova/nova/compute/manager.py:7818}}
[  884.440995] env[65478]: DEBUG nova.compute.manager [None req-21f3adec-bf06-4a37-976e-15340d27ae0d tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] network_info to inject: |[{"id": "a4636485-7b6f-4fbb-ab94-d4f75ada7a1c", "address": "fa:16:3e:bc:0f:ab", "network": {"id": "432219d2-eada-4b7b-82da-1951de930922", "bridge": "br-int", "label": "tempest-AttachInterfacesUnderV243Test-1661348426-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "10.180.180.155", "type": "floating", "version": 4, "meta": {}}]}, {"address": "192.168.128.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "1f872aa3128c4866aed16d152b15486f", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "8b1a0b17-d008-4a8b-be2a-796ff1a9a2d1", "external-id": "nsx-vlan-transportzone-880", "segmentation_id": 880, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapa4636485-7b", "ovs_interfaceid": "a4636485-7b6f-4fbb-ab94-d4f75ada7a1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _inject_network_info /opt/stack/nova/nova/compute/manager.py:7819}}
[  884.446383] env[65478]: DEBUG oslo_concurrency.lockutils [req-9f7ca2e4-449e-41d1-ac86-e4b556e5c28f req-feda8344-d5c3-4323-812e-a6fe0a5e5f6a service nova] Acquired lock "refresh_cache-d978e71d-2c30-4a76-b000-6ddf3203ab10" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  884.447067] env[65478]: DEBUG nova.network.neutron [req-9f7ca2e4-449e-41d1-ac86-e4b556e5c28f req-feda8344-d5c3-4323-812e-a6fe0a5e5f6a service nova] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Refreshing network info cache for port a4636485-7b6f-4fbb-ab94-d4f75ada7a1c {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  884.448918] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-21f3adec-bf06-4a37-976e-15340d27ae0d tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Reconfiguring VM instance to set the machine id {{(pid=65478) _set_machine_id /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1796}}
[  884.451231] env[65478]: DEBUG oslo_vmware.service [None req-21f3adec-bf06-4a37-976e-15340d27ae0d tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-8110a038-ab91-494f-a4f9-9d155943812e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  884.469479] env[65478]: DEBUG oslo_vmware.api [None req-21f3adec-bf06-4a37-976e-15340d27ae0d tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Waiting for the task: (returnval){
[  884.469479] env[65478]:    value = "task-6011849"
[  884.469479] env[65478]:    _type = "Task"
[  884.469479] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  884.478711] env[65478]: DEBUG oslo_vmware.api [None req-21f3adec-bf06-4a37-976e-15340d27ae0d tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Task: {'id': task-6011849, 'name': ReconfigVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  884.735200] env[65478]: DEBUG nova.objects.instance [None req-272acc0a-2e6b-4aa1-a34d-b7af7090ec5b tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Lazy-loading 'flavor' on Instance uuid d978e71d-2c30-4a76-b000-6ddf3203ab10 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  884.759106] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  884.950388] env[65478]: WARNING neutronclient.v2_0.client [req-9f7ca2e4-449e-41d1-ac86-e4b556e5c28f req-feda8344-d5c3-4323-812e-a6fe0a5e5f6a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  884.980296] env[65478]: DEBUG oslo_vmware.api [None req-21f3adec-bf06-4a37-976e-15340d27ae0d tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Task: {'id': task-6011849, 'name': ReconfigVM_Task, 'duration_secs': 0.160884} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  884.980978] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-21f3adec-bf06-4a37-976e-15340d27ae0d tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Reconfigured VM instance to set the machine id {{(pid=65478) _set_machine_id /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1799}}
[  885.241432] env[65478]: DEBUG oslo_concurrency.lockutils [None req-272acc0a-2e6b-4aa1-a34d-b7af7090ec5b tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Acquiring lock "refresh_cache-d978e71d-2c30-4a76-b000-6ddf3203ab10" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  885.268490] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[  885.268490] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 9.290s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  885.268751] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  885.269830] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Cleaning up deleted instances {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11960}}
[  885.272193] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 12.720s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  885.274722] env[65478]: WARNING neutronclient.v2_0.client [req-9f7ca2e4-449e-41d1-ac86-e4b556e5c28f req-feda8344-d5c3-4323-812e-a6fe0a5e5f6a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  885.359451] env[65478]: DEBUG oslo_vmware.rw_handles [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Getting lease state for https://esx7c1n3.openstack.eu-de-1.cloud.sap/nfc/523cab81-a556-d124-4a06-d0d233c30830/disk-0.vmdk. {{(pid=65478) _release_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:423}}
[  885.360217] env[65478]: DEBUG oslo_vmware.service [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-acff34ff-90d7-4635-83d5-849bfb52256a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  885.368437] env[65478]: DEBUG oslo_vmware.rw_handles [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lease for https://esx7c1n3.openstack.eu-de-1.cloud.sap/nfc/523cab81-a556-d124-4a06-d0d233c30830/disk-0.vmdk is in state: ready. {{(pid=65478) _release_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:430}}
[  885.368437] env[65478]: ERROR oslo_vmware.rw_handles [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Aborting lease for https://esx7c1n3.openstack.eu-de-1.cloud.sap/nfc/523cab81-a556-d124-4a06-d0d233c30830/disk-0.vmdk due to incomplete transfer.
[  885.368437] env[65478]: DEBUG oslo_vmware.service [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking HttpNfcLease.HttpNfcLeaseAbort with opID=oslo.vmware-821d45b9-607d-49f1-aa09-080d8fa3508c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  885.381159] env[65478]: DEBUG oslo_vmware.rw_handles [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Closed VMDK read handle for https://esx7c1n3.openstack.eu-de-1.cloud.sap/nfc/523cab81-a556-d124-4a06-d0d233c30830/disk-0.vmdk. {{(pid=65478) close /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:735}}
[  885.381557] env[65478]: DEBUG nova.virt.vmwareapi.images [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Uploaded image c8c39da2-6a16-4dab-9d90-ba211440ae15 to the Glance image server {{(pid=65478) upload_image_stream_optimized /opt/stack/nova/nova/virt/vmwareapi/images.py:472}}
[  885.383447] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Destroying the VM {{(pid=65478) destroy_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1368}}
[  885.384274] env[65478]: DEBUG oslo_vmware.service [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualMachine.Destroy_Task with opID=oslo.vmware-2a949d5d-222d-4704-8356-83c652cdf1c7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  885.390994] env[65478]: DEBUG oslo_vmware.api [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  885.390994] env[65478]:    value = "task-6011850"
[  885.390994] env[65478]:    _type = "Task"
[  885.390994] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  885.404916] env[65478]: DEBUG oslo_vmware.api [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011850, 'name': Destroy_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  885.409722] env[65478]: DEBUG nova.network.neutron [req-9f7ca2e4-449e-41d1-ac86-e4b556e5c28f req-feda8344-d5c3-4323-812e-a6fe0a5e5f6a service nova] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Updated VIF entry in instance network info cache for port a4636485-7b6f-4fbb-ab94-d4f75ada7a1c. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  885.409850] env[65478]: DEBUG nova.network.neutron [req-9f7ca2e4-449e-41d1-ac86-e4b556e5c28f req-feda8344-d5c3-4323-812e-a6fe0a5e5f6a service nova] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Updating instance_info_cache with network_info: [{"id": "a4636485-7b6f-4fbb-ab94-d4f75ada7a1c", "address": "fa:16:3e:bc:0f:ab", "network": {"id": "432219d2-eada-4b7b-82da-1951de930922", "bridge": "br-int", "label": "tempest-AttachInterfacesUnderV243Test-1661348426-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "10.180.180.155", "type": "floating", "version": 4, "meta": {}}]}, {"address": "192.168.128.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "1f872aa3128c4866aed16d152b15486f", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "8b1a0b17-d008-4a8b-be2a-796ff1a9a2d1", "external-id": "nsx-vlan-transportzone-880", "segmentation_id": 880, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapa4636485-7b", "ovs_interfaceid": "a4636485-7b6f-4fbb-ab94-d4f75ada7a1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  885.790601] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] There are 21 instances to clean {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11969}}
[  885.790601] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: 28200981-9217-4395-b0a8-c154624c7a1c] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[  885.902323] env[65478]: DEBUG oslo_vmware.api [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011850, 'name': Destroy_Task, 'duration_secs': 0.371544} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  885.903568] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Destroyed the VM
[  885.904279] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Deleting Snapshot of the VM instance {{(pid=65478) _delete_vm_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:932}}
[  885.904279] env[65478]: DEBUG oslo_vmware.service [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualMachineSnapshot.RemoveSnapshot_Task with opID=oslo.vmware-129a415b-88b2-49f3-b596-94aa5d4d2469 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  885.910339] env[65478]: DEBUG oslo_vmware.api [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  885.910339] env[65478]:    value = "task-6011851"
[  885.910339] env[65478]:    _type = "Task"
[  885.910339] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  885.915922] env[65478]: DEBUG oslo_concurrency.lockutils [req-9f7ca2e4-449e-41d1-ac86-e4b556e5c28f req-feda8344-d5c3-4323-812e-a6fe0a5e5f6a service nova] Releasing lock "refresh_cache-d978e71d-2c30-4a76-b000-6ddf3203ab10" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  885.922570] env[65478]: DEBUG oslo_concurrency.lockutils [None req-272acc0a-2e6b-4aa1-a34d-b7af7090ec5b tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Acquired lock "refresh_cache-d978e71d-2c30-4a76-b000-6ddf3203ab10" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  885.922570] env[65478]: WARNING neutronclient.v2_0.client [None req-272acc0a-2e6b-4aa1-a34d-b7af7090ec5b tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  885.928198] env[65478]: DEBUG oslo_vmware.api [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011851, 'name': RemoveSnapshot_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  886.294399] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: b5a974d7-e117-4b99-9b0c-f9c8a7cfec4f] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[  886.373363] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Acquiring lock "e9f84a20-8def-4f36-92eb-8625364f7024" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  886.373575] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Lock "e9f84a20-8def-4f36-92eb-8625364f7024" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  886.373773] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Acquiring lock "e9f84a20-8def-4f36-92eb-8625364f7024-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  886.373917] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Lock "e9f84a20-8def-4f36-92eb-8625364f7024-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  886.374055] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Lock "e9f84a20-8def-4f36-92eb-8625364f7024-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  886.378661] env[65478]: INFO nova.compute.manager [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Terminating instance
[  886.422830] env[65478]: DEBUG oslo_vmware.api [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011851, 'name': RemoveSnapshot_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  886.525335] env[65478]: DEBUG oslo_vmware.service [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-25bbfa89-eac3-464c-ad18-f1d08369f1ca {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  886.533622] env[65478]: DEBUG oslo_vmware.service [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-be974073-cf04-4be5-8148-b24a197c4cf5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  886.584916] env[65478]: DEBUG oslo_vmware.service [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-572468e3-8fee-43e5-9fee-02cf498cd91b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  886.588772] env[65478]: DEBUG nova.network.neutron [None req-272acc0a-2e6b-4aa1-a34d-b7af7090ec5b tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  886.597195] env[65478]: DEBUG oslo_vmware.service [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-58fdf5d8-d4ba-4199-b8b6-126fcce7cb52 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  886.613517] env[65478]: DEBUG nova.compute.provider_tree [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  886.722671] env[65478]: DEBUG nova.compute.manager [req-72c77199-707b-4bdc-8f00-46d808a3cacb req-24740214-8a04-471b-bb93-bc3f4c500022 service nova] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Received event network-changed-a4636485-7b6f-4fbb-ab94-d4f75ada7a1c {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  886.723339] env[65478]: DEBUG nova.compute.manager [req-72c77199-707b-4bdc-8f00-46d808a3cacb req-24740214-8a04-471b-bb93-bc3f4c500022 service nova] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Refreshing instance network info cache due to event network-changed-a4636485-7b6f-4fbb-ab94-d4f75ada7a1c. {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}}
[  886.723503] env[65478]: DEBUG oslo_concurrency.lockutils [req-72c77199-707b-4bdc-8f00-46d808a3cacb req-24740214-8a04-471b-bb93-bc3f4c500022 service nova] Acquiring lock "refresh_cache-d978e71d-2c30-4a76-b000-6ddf3203ab10" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  886.800343] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: 6ef7bbde-0ba8-44a9-8643-e674a14f3cbc] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[  886.884540] env[65478]: DEBUG nova.compute.manager [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[  886.884603] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  886.888806] env[65478]: DEBUG oslo_vmware.service [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3ff8a8c4-f5ee-4d34-8203-369627f6174b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  886.893841] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  886.894159] env[65478]: DEBUG oslo_vmware.service [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-66177fe1-aba0-4f5e-97c0-0eb07ef6e6f1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  886.900379] env[65478]: DEBUG oslo_vmware.api [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Waiting for the task: (returnval){
[  886.900379] env[65478]:    value = "task-6011852"
[  886.900379] env[65478]:    _type = "Task"
[  886.900379] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  886.909859] env[65478]: DEBUG oslo_vmware.api [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011852, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  886.921260] env[65478]: DEBUG oslo_vmware.api [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011851, 'name': RemoveSnapshot_Task, 'duration_secs': 0.584493} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  886.921607] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Deleted Snapshot of the VM instance {{(pid=65478) _delete_vm_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:938}}
[  886.921765] env[65478]: INFO nova.compute.manager [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Took 13.94 seconds to snapshot the instance on the hypervisor.
[  887.091734] env[65478]: WARNING neutronclient.v2_0.client [None req-272acc0a-2e6b-4aa1-a34d-b7af7090ec5b tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  887.116615] env[65478]: DEBUG nova.scheduler.client.report [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  887.307621] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: 4c0f39b0-e3b5-4cdf-81ea-e1bf02f8e4b3] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[  887.348173] env[65478]: WARNING neutronclient.v2_0.client [None req-272acc0a-2e6b-4aa1-a34d-b7af7090ec5b tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  887.410311] env[65478]: DEBUG oslo_vmware.api [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011852, 'name': PowerOffVM_Task, 'duration_secs': 0.174231} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  887.411025] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  887.411025] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  887.411025] env[65478]: DEBUG oslo_vmware.service [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-382d0b45-a843-43e0-86a2-d996b20d8bfb {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  887.433462] env[65478]: DEBUG nova.network.neutron [None req-272acc0a-2e6b-4aa1-a34d-b7af7090ec5b tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Updating instance_info_cache with network_info: [{"id": "a4636485-7b6f-4fbb-ab94-d4f75ada7a1c", "address": "fa:16:3e:bc:0f:ab", "network": {"id": "432219d2-eada-4b7b-82da-1951de930922", "bridge": "br-int", "label": "tempest-AttachInterfacesUnderV243Test-1661348426-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "10.180.180.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "1f872aa3128c4866aed16d152b15486f", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "8b1a0b17-d008-4a8b-be2a-796ff1a9a2d1", "external-id": "nsx-vlan-transportzone-880", "segmentation_id": 880, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapa4636485-7b", "ovs_interfaceid": "a4636485-7b6f-4fbb-ab94-d4f75ada7a1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  887.466080] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  887.466257] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Deleting contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  887.467673] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Deleting the datastore file [datastore1] e9f84a20-8def-4f36-92eb-8625364f7024 {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  887.467976] env[65478]: DEBUG oslo_vmware.service [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-6fdec990-cc7f-49e1-80e9-20381c0f6015 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  887.475615] env[65478]: DEBUG oslo_vmware.api [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Waiting for the task: (returnval){
[  887.475615] env[65478]:    value = "task-6011854"
[  887.475615] env[65478]:    _type = "Task"
[  887.475615] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  887.485104] env[65478]: DEBUG oslo_vmware.api [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011854, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  887.493081] env[65478]: DEBUG nova.compute.manager [None req-ff1a01e5-1a7b-4b18-9f94-5491ebde9d6e tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Found 2 images (rotation: 2) {{(pid=65478) _rotate_backups /opt/stack/nova/nova/compute/manager.py:5098}}
[  887.812243] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: 4821048b-4b5a-40b5-8888-f00dd28425d1] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[  887.936240] env[65478]: DEBUG oslo_concurrency.lockutils [None req-272acc0a-2e6b-4aa1-a34d-b7af7090ec5b tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Releasing lock "refresh_cache-d978e71d-2c30-4a76-b000-6ddf3203ab10" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  887.936434] env[65478]: DEBUG nova.compute.manager [None req-272acc0a-2e6b-4aa1-a34d-b7af7090ec5b tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Inject network info {{(pid=65478) _inject_network_info /opt/stack/nova/nova/compute/manager.py:7818}}
[  887.936659] env[65478]: DEBUG nova.compute.manager [None req-272acc0a-2e6b-4aa1-a34d-b7af7090ec5b tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] network_info to inject: |[{"id": "a4636485-7b6f-4fbb-ab94-d4f75ada7a1c", "address": "fa:16:3e:bc:0f:ab", "network": {"id": "432219d2-eada-4b7b-82da-1951de930922", "bridge": "br-int", "label": "tempest-AttachInterfacesUnderV243Test-1661348426-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "10.180.180.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "1f872aa3128c4866aed16d152b15486f", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "8b1a0b17-d008-4a8b-be2a-796ff1a9a2d1", "external-id": "nsx-vlan-transportzone-880", "segmentation_id": 880, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapa4636485-7b", "ovs_interfaceid": "a4636485-7b6f-4fbb-ab94-d4f75ada7a1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=65478) _inject_network_info /opt/stack/nova/nova/compute/manager.py:7819}}
[  887.941750] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-272acc0a-2e6b-4aa1-a34d-b7af7090ec5b tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Reconfiguring VM instance to set the machine id {{(pid=65478) _set_machine_id /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1796}}
[  887.942092] env[65478]: DEBUG oslo_concurrency.lockutils [req-72c77199-707b-4bdc-8f00-46d808a3cacb req-24740214-8a04-471b-bb93-bc3f4c500022 service nova] Acquired lock "refresh_cache-d978e71d-2c30-4a76-b000-6ddf3203ab10" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  887.942492] env[65478]: DEBUG oslo_vmware.service [None req-272acc0a-2e6b-4aa1-a34d-b7af7090ec5b tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-58e4e6fa-9a44-4e32-8b48-82ffee8bb878 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  887.947838] env[65478]: DEBUG nova.network.neutron [req-72c77199-707b-4bdc-8f00-46d808a3cacb req-24740214-8a04-471b-bb93-bc3f4c500022 service nova] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Refreshing network info cache for port a4636485-7b6f-4fbb-ab94-d4f75ada7a1c {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
[  887.960815] env[65478]: DEBUG oslo_vmware.api [None req-272acc0a-2e6b-4aa1-a34d-b7af7090ec5b tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Waiting for the task: (returnval){
[  887.960815] env[65478]:    value = "task-6011855"
[  887.960815] env[65478]:    _type = "Task"
[  887.960815] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  887.969247] env[65478]: DEBUG oslo_vmware.api [None req-272acc0a-2e6b-4aa1-a34d-b7af7090ec5b tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Task: {'id': task-6011855, 'name': ReconfigVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  887.985757] env[65478]: DEBUG oslo_vmware.api [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Task: {'id': task-6011854, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.128626} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  887.985953] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  887.986182] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Deleted contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  887.986339] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  887.986477] env[65478]: INFO nova.compute.manager [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Took 1.10 seconds to destroy the instance on the hypervisor.
[  887.987090] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  887.987373] env[65478]: DEBUG nova.compute.manager [-] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[  887.987483] env[65478]: DEBUG nova.network.neutron [-] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[  887.987812] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  888.027043] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  888.128212] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.859s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  888.131915] env[65478]: DEBUG oslo_concurrency.lockutils [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 14.268s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  888.132224] env[65478]: DEBUG oslo_concurrency.lockutils [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.004s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  888.168298] env[65478]: INFO nova.scheduler.client.report [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Deleted allocations for instance f0e88cef-300d-42a4-9cb6-843dc85da6a3
[  888.316477] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: f01c577a-3995-465a-98ae-21880df54cc0] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[  888.360487] env[65478]: DEBUG nova.compute.manager [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  888.361628] env[65478]: DEBUG oslo_vmware.service [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3676098e-122f-4953-a928-81bac0fdca62 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  888.427484] env[65478]: DEBUG nova.compute.manager [req-0f928848-5780-404f-b6b6-3432f42feaff req-651fb6f5-6474-4fdc-b2d0-e168a05a0d21 service nova] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Received event network-vif-deleted-ad31d75c-ffad-4983-9c4c-24cd6a13c154 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  888.429451] env[65478]: INFO nova.compute.manager [req-0f928848-5780-404f-b6b6-3432f42feaff req-651fb6f5-6474-4fdc-b2d0-e168a05a0d21 service nova] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Neutron deleted interface ad31d75c-ffad-4983-9c4c-24cd6a13c154; detaching it from the instance and deleting it from the info cache
[  888.429541] env[65478]: DEBUG nova.network.neutron [req-0f928848-5780-404f-b6b6-3432f42feaff req-651fb6f5-6474-4fdc-b2d0-e168a05a0d21 service nova] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  888.462128] env[65478]: WARNING neutronclient.v2_0.client [req-72c77199-707b-4bdc-8f00-46d808a3cacb req-24740214-8a04-471b-bb93-bc3f4c500022 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  888.470896] env[65478]: DEBUG oslo_vmware.api [None req-272acc0a-2e6b-4aa1-a34d-b7af7090ec5b tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Task: {'id': task-6011855, 'name': ReconfigVM_Task, 'duration_secs': 0.149217} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  888.471104] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-272acc0a-2e6b-4aa1-a34d-b7af7090ec5b tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Reconfigured VM instance to set the machine id {{(pid=65478) _set_machine_id /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1799}}
[  888.640488] env[65478]: WARNING neutronclient.v2_0.client [req-72c77199-707b-4bdc-8f00-46d808a3cacb req-24740214-8a04-471b-bb93-bc3f4c500022 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  888.677898] env[65478]: DEBUG oslo_concurrency.lockutils [None req-da025e50-238d-481c-90ac-b91831fff734 tempest-ServersTestJSON-1565476061 tempest-ServersTestJSON-1565476061-project-member] Lock "f0e88cef-300d-42a4-9cb6-843dc85da6a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 18.707s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  888.707120] env[65478]: INFO nova.scheduler.client.report [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Deleted allocation for migration f558a7ca-024a-4401-b9e1-cfa6bff8bb87
[  888.729150] env[65478]: DEBUG nova.network.neutron [req-72c77199-707b-4bdc-8f00-46d808a3cacb req-24740214-8a04-471b-bb93-bc3f4c500022 service nova] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Updated VIF entry in instance network info cache for port a4636485-7b6f-4fbb-ab94-d4f75ada7a1c. {{(pid=65478) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
[  888.729468] env[65478]: DEBUG nova.network.neutron [req-72c77199-707b-4bdc-8f00-46d808a3cacb req-24740214-8a04-471b-bb93-bc3f4c500022 service nova] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Updating instance_info_cache with network_info: [{"id": "a4636485-7b6f-4fbb-ab94-d4f75ada7a1c", "address": "fa:16:3e:bc:0f:ab", "network": {"id": "432219d2-eada-4b7b-82da-1951de930922", "bridge": "br-int", "label": "tempest-AttachInterfacesUnderV243Test-1661348426-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "10.180.180.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "1f872aa3128c4866aed16d152b15486f", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "8b1a0b17-d008-4a8b-be2a-796ff1a9a2d1", "external-id": "nsx-vlan-transportzone-880", "segmentation_id": 880, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapa4636485-7b", "ovs_interfaceid": "a4636485-7b6f-4fbb-ab94-d4f75ada7a1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  888.821600] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: 788343e6-5c24-4e9b-9c74-e14f3b179cdb] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[  888.823715] env[65478]: DEBUG nova.network.neutron [-] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  888.873084] env[65478]: INFO nova.compute.manager [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] instance snapshotting
[  888.873657] env[65478]: DEBUG nova.objects.instance [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lazy-loading 'flavor' on Instance uuid 9b286a00-af27-4012-a596-45bbe98da254 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  888.932827] env[65478]: DEBUG oslo_vmware.service [req-0f928848-5780-404f-b6b6-3432f42feaff req-651fb6f5-6474-4fdc-b2d0-e168a05a0d21 service nova] Invoking SearchIndex.FindAllByUuid with opID=oslo.vmware-c13fbedd-030f-44f7-bbdd-ef75826d7eb7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  888.941729] env[65478]: DEBUG oslo_vmware.service [req-0f928848-5780-404f-b6b6-3432f42feaff req-651fb6f5-6474-4fdc-b2d0-e168a05a0d21 service nova] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-53cc1c6f-3b6b-4c0c-a02b-785a46786a29 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  888.984465] env[65478]: DEBUG nova.compute.manager [req-0f928848-5780-404f-b6b6-3432f42feaff req-651fb6f5-6474-4fdc-b2d0-e168a05a0d21 service nova] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Detach interface failed, port_id=ad31d75c-ffad-4983-9c4c-24cd6a13c154, reason: Instance e9f84a20-8def-4f36-92eb-8625364f7024 could not be found. {{(pid=65478) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}}
[  889.015481] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Acquiring lock "d978e71d-2c30-4a76-b000-6ddf3203ab10" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  889.015481] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Lock "d978e71d-2c30-4a76-b000-6ddf3203ab10" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  889.015481] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Acquiring lock "d978e71d-2c30-4a76-b000-6ddf3203ab10-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  889.015481] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Lock "d978e71d-2c30-4a76-b000-6ddf3203ab10-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  889.015481] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Lock "d978e71d-2c30-4a76-b000-6ddf3203ab10-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  889.017594] env[65478]: INFO nova.compute.manager [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Terminating instance
[  889.212541] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7a00b55b-9acc-4981-bb1a-c67e957431f7 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Lock "6f6c4cda-9439-47dd-810c-25b0516585e6" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 19.656s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  889.231591] env[65478]: DEBUG oslo_concurrency.lockutils [req-72c77199-707b-4bdc-8f00-46d808a3cacb req-24740214-8a04-471b-bb93-bc3f4c500022 service nova] Releasing lock "refresh_cache-d978e71d-2c30-4a76-b000-6ddf3203ab10" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  889.325733] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: eb076624-c76c-47da-9320-5fc13a51b365] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[  889.327701] env[65478]: INFO nova.compute.manager [-] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Took 1.34 seconds to deallocate network for instance.
[  889.380586] env[65478]: DEBUG oslo_vmware.service [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-bc86e41a-0407-489f-b6c1-f4544e13734c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  889.404123] env[65478]: DEBUG oslo_vmware.service [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-949fc822-b9b4-46a5-8475-34ce5b1f8c71 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  889.521545] env[65478]: DEBUG nova.compute.manager [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[  889.521712] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  889.522713] env[65478]: DEBUG oslo_vmware.service [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-29b3e254-1a6a-4bcb-9380-a6bbf656ba03 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  889.530388] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  889.532639] env[65478]: DEBUG oslo_vmware.service [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-66451229-6f1e-4eac-ad2c-88614f843ad4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  889.539276] env[65478]: DEBUG oslo_vmware.api [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Waiting for the task: (returnval){
[  889.539276] env[65478]:    value = "task-6011856"
[  889.539276] env[65478]:    _type = "Task"
[  889.539276] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  889.547634] env[65478]: DEBUG oslo_vmware.api [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Task: {'id': task-6011856, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  889.828544] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: eb466e5e-a499-4856-9c12-c7ca87b53230] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[  889.835694] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  889.836281] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  889.837437] env[65478]: DEBUG nova.objects.instance [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Lazy-loading 'resources' on Instance uuid e9f84a20-8def-4f36-92eb-8625364f7024 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  889.915146] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Creating Snapshot of the VM instance {{(pid=65478) _create_vm_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:913}}
[  889.915811] env[65478]: DEBUG oslo_vmware.service [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualMachine.CreateSnapshot_Task with opID=oslo.vmware-e039b7ff-b938-405a-89d3-a29adfd1a8f2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  889.922720] env[65478]: DEBUG oslo_vmware.api [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  889.922720] env[65478]:    value = "task-6011857"
[  889.922720] env[65478]:    _type = "Task"
[  889.922720] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  889.932465] env[65478]: DEBUG oslo_vmware.api [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011857, 'name': CreateSnapshot_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  890.055911] env[65478]: DEBUG oslo_vmware.api [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Task: {'id': task-6011856, 'name': PowerOffVM_Task, 'duration_secs': 0.197502} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  890.055911] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  890.055911] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  890.055911] env[65478]: DEBUG oslo_vmware.service [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-bfb7ffb3-35d3-4dd7-b7f3-676b57b1812d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  890.112817] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  890.112999] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Deleting contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  890.113133] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Deleting the datastore file [datastore1] d978e71d-2c30-4a76-b000-6ddf3203ab10 {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  890.113397] env[65478]: DEBUG oslo_vmware.service [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-2a911c2c-2325-41e6-8049-3a03150534a9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  890.120469] env[65478]: DEBUG oslo_vmware.api [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Waiting for the task: (returnval){
[  890.120469] env[65478]:    value = "task-6011859"
[  890.120469] env[65478]:    _type = "Task"
[  890.120469] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  890.129648] env[65478]: DEBUG oslo_vmware.api [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Task: {'id': task-6011859, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  890.334508] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: 4f7fb80a-cb05-4bd5-bb10-380d95b2e892] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[  890.436561] env[65478]: DEBUG oslo_vmware.api [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011857, 'name': CreateSnapshot_Task} progress is 100%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  890.630086] env[65478]: DEBUG oslo_vmware.api [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Task: {'id': task-6011859, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.133454} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  890.630282] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  890.630549] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Deleted contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  890.630684] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  890.630813] env[65478]: INFO nova.compute.manager [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Took 1.11 seconds to destroy the instance on the hypervisor.
[  890.631444] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  890.631615] env[65478]: DEBUG nova.compute.manager [-] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[  890.631786] env[65478]: DEBUG nova.network.neutron [-] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[  890.633693] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  890.737147] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  890.837580] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: 88cd130c-b811-4789-aea2-964848abdd69] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[  890.866315] env[65478]: DEBUG oslo_vmware.service [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-567d8a49-5b90-4815-9112-8cce95d9bdd2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  890.873654] env[65478]: DEBUG oslo_vmware.service [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ab7629f3-9ca5-4e14-8958-c91e6f2776be {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  890.912010] env[65478]: DEBUG oslo_vmware.service [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4c96cf7d-1fa7-4f3a-86dd-06799ca6b2f8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  890.919887] env[65478]: DEBUG oslo_vmware.service [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c743edc7-d174-43a1-94ad-ec3ad9386741 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  890.933935] env[65478]: DEBUG oslo_vmware.api [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011857, 'name': CreateSnapshot_Task} progress is 100%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  890.941978] env[65478]: DEBUG nova.compute.provider_tree [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  891.341732] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: 6a23cbd2-7031-484c-809e-436397029c7d] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[  891.440037] env[65478]: DEBUG oslo_vmware.api [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011857, 'name': CreateSnapshot_Task} progress is 100%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  891.444971] env[65478]: DEBUG nova.scheduler.client.report [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  891.818235] env[65478]: DEBUG nova.network.neutron [-] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  891.844577] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: 98b2d40a-0c59-4540-b60e-17e5206dea42] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[  891.940029] env[65478]: DEBUG oslo_vmware.api [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011857, 'name': CreateSnapshot_Task, 'duration_secs': 1.736468} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  891.940761] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Created Snapshot of the VM instance {{(pid=65478) _create_vm_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:922}}
[  891.942047] env[65478]: DEBUG oslo_vmware.service [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-2f79c080-d689-4498-9d2f-ee47942cad72 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  891.955405] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.119s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  892.088662] env[65478]: DEBUG nova.compute.manager [req-8db1bc94-b422-4b85-88e2-a262a22deb0f req-fffc8c14-de67-4c54-8de8-fd6755114d4e service nova] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Received event network-vif-deleted-a4636485-7b6f-4fbb-ab94-d4f75ada7a1c {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  892.157414] env[65478]: INFO nova.scheduler.client.report [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Deleted allocations for instance e9f84a20-8def-4f36-92eb-8625364f7024
[  892.320527] env[65478]: INFO nova.compute.manager [-] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Took 1.69 seconds to deallocate network for instance.
[  892.355648] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: c444ace8-9651-4df8-8604-982300643449] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[  892.470921] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Creating linked-clone VM from snapshot {{(pid=65478) _create_linked_clone_from_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:955}}
[  892.471356] env[65478]: DEBUG oslo_vmware.service [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualMachine.CloneVM_Task with opID=oslo.vmware-f8b84905-6efe-4e46-a7d0-a9e6d134933f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  892.484662] env[65478]: DEBUG oslo_vmware.api [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  892.484662] env[65478]:    value = "task-6011860"
[  892.484662] env[65478]:    _type = "Task"
[  892.484662] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  892.493254] env[65478]: DEBUG oslo_vmware.api [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011860, 'name': CloneVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  892.666487] env[65478]: DEBUG oslo_concurrency.lockutils [None req-7aafbaec-45e1-4e9a-845c-8bd62364fbf7 tempest-ImagesOneServerTestJSON-897000472 tempest-ImagesOneServerTestJSON-897000472-project-member] Lock "e9f84a20-8def-4f36-92eb-8625364f7024" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.293s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  892.828709] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  892.828709] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  892.828709] env[65478]: DEBUG nova.objects.instance [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Lazy-loading 'resources' on Instance uuid d978e71d-2c30-4a76-b000-6ddf3203ab10 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  892.860044] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: 95525483-b7db-427e-87b5-3f946972a250] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[  892.994347] env[65478]: DEBUG oslo_vmware.api [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011860, 'name': CloneVM_Task} progress is 94%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  893.038383] env[65478]: DEBUG oslo_concurrency.lockutils [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Acquiring lock "fbf21f21-d370-4a6a-ae24-0e6840464e24" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  893.038582] env[65478]: DEBUG oslo_concurrency.lockutils [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Lock "fbf21f21-d370-4a6a-ae24-0e6840464e24" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  893.038763] env[65478]: DEBUG oslo_concurrency.lockutils [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Acquiring lock "fbf21f21-d370-4a6a-ae24-0e6840464e24-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  893.038906] env[65478]: DEBUG oslo_concurrency.lockutils [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Lock "fbf21f21-d370-4a6a-ae24-0e6840464e24-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  893.039052] env[65478]: DEBUG oslo_concurrency.lockutils [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Lock "fbf21f21-d370-4a6a-ae24-0e6840464e24-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  893.041244] env[65478]: INFO nova.compute.manager [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Terminating instance
[  893.362824] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: 06b7de0a-c338-44b8-97e7-c80281067528] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[  893.495387] env[65478]: DEBUG oslo_vmware.api [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011860, 'name': CloneVM_Task} progress is 94%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  893.544699] env[65478]: DEBUG nova.compute.manager [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[  893.545174] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  893.545866] env[65478]: DEBUG oslo_vmware.service [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8cb5ad8b-6c24-4096-a395-9989d659dd0e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  893.553163] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  893.553417] env[65478]: DEBUG oslo_vmware.service [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-9b818069-c548-4861-8830-0beee3afae70 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  893.558556] env[65478]: DEBUG oslo_vmware.api [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Waiting for the task: (returnval){
[  893.558556] env[65478]:    value = "task-6011861"
[  893.558556] env[65478]:    _type = "Task"
[  893.558556] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  893.566713] env[65478]: DEBUG oslo_vmware.api [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Task: {'id': task-6011861, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  893.822681] env[65478]: DEBUG oslo_vmware.service [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0f7a4e67-be14-480a-b429-86cc0dfbe530 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  893.833179] env[65478]: DEBUG oslo_vmware.service [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3abd9c1e-0453-49e7-9153-a25fabff41f3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  893.868870] env[65478]: DEBUG oslo_vmware.service [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f88c7f4a-940f-4574-810f-42662d864329 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  893.872246] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: 230cc05f-433e-4510-947f-35466335662d] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[  893.879466] env[65478]: DEBUG oslo_vmware.service [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1124ac2d-a0b4-4853-835a-365adddce4cf {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  893.895758] env[65478]: DEBUG nova.compute.provider_tree [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  893.995801] env[65478]: DEBUG oslo_vmware.api [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011860, 'name': CloneVM_Task} progress is 95%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  894.072305] env[65478]: DEBUG oslo_vmware.api [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Task: {'id': task-6011861, 'name': PowerOffVM_Task, 'duration_secs': 0.202287} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  894.072520] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  894.072665] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  894.072965] env[65478]: DEBUG oslo_vmware.service [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-1cfe9704-edeb-427f-840e-0a21f2887c5f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  894.132363] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  894.132742] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Deleting contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  894.132934] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Deleting the datastore file [datastore1] fbf21f21-d370-4a6a-ae24-0e6840464e24 {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  894.133255] env[65478]: DEBUG oslo_vmware.service [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-b7b59bba-4701-4048-82ae-a710f5a4c907 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  894.139808] env[65478]: DEBUG oslo_vmware.api [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Waiting for the task: (returnval){
[  894.139808] env[65478]:    value = "task-6011863"
[  894.139808] env[65478]:    _type = "Task"
[  894.139808] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  894.154701] env[65478]: DEBUG oslo_vmware.api [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Task: {'id': task-6011863, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  894.375924] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: 7507f1f3-c896-492c-9e9b-ebbd47b7c629] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[  894.399533] env[65478]: DEBUG nova.scheduler.client.report [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  894.495749] env[65478]: DEBUG oslo_vmware.api [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011860, 'name': CloneVM_Task, 'duration_secs': 1.804231} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  894.495940] env[65478]: INFO nova.virt.vmwareapi.vmops [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Created linked-clone VM from snapshot
[  894.496677] env[65478]: DEBUG oslo_vmware.service [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0c9f3793-894f-43ea-8773-c80b827a1c5f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  894.503763] env[65478]: DEBUG nova.virt.vmwareapi.images [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Uploading image 1d1dd84d-7c54-45d2-ace2-3da053a8ae54 {{(pid=65478) upload_image_stream_optimized /opt/stack/nova/nova/virt/vmwareapi/images.py:441}}
[  894.535236] env[65478]: DEBUG oslo_vmware.rw_handles [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Creating HttpNfcLease lease for exporting VM: (result){
[  894.535236] env[65478]:    value = "vm-1161301"
[  894.535236] env[65478]:    _type = "VirtualMachine"
[  894.535236] env[65478]:  }. {{(pid=65478) _create_export_vm_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:478}}
[  894.535785] env[65478]: DEBUG oslo_vmware.service [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualMachine.ExportVm with opID=oslo.vmware-acb0e513-194c-46c0-967a-267d8cec50ef {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  894.544180] env[65478]: DEBUG oslo_vmware.rw_handles [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lease: (returnval){
[  894.544180] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c93e36-de2f-5880-a6c0-e3de0c5b7642"
[  894.544180] env[65478]:    _type = "HttpNfcLease"
[  894.544180] env[65478]:  } obtained for exporting VM: (result){
[  894.544180] env[65478]:    value = "vm-1161301"
[  894.544180] env[65478]:    _type = "VirtualMachine"
[  894.544180] env[65478]:  }. {{(pid=65478) _create_export_vm_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:481}}
[  894.544823] env[65478]: DEBUG oslo_vmware.api [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the lease: (returnval){
[  894.544823] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c93e36-de2f-5880-a6c0-e3de0c5b7642"
[  894.544823] env[65478]:    _type = "HttpNfcLease"
[  894.544823] env[65478]:  } to be ready. {{(pid=65478) wait_for_lease_ready /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:462}}
[  894.552844] env[65478]: DEBUG oslo_vmware.api [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lease: (returnval){
[  894.552844] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c93e36-de2f-5880-a6c0-e3de0c5b7642"
[  894.552844] env[65478]:    _type = "HttpNfcLease"
[  894.552844] env[65478]:  } is initializing. {{(pid=65478) _poll_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:490}}
[  894.649700] env[65478]: DEBUG oslo_vmware.api [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Task: {'id': task-6011863, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.139111} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  894.650108] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  894.650264] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Deleted contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  894.650394] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  894.651132] env[65478]: INFO nova.compute.manager [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Took 1.11 seconds to destroy the instance on the hypervisor.
[  894.651715] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  894.651981] env[65478]: DEBUG nova.compute.manager [-] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[  894.652124] env[65478]: DEBUG nova.network.neutron [-] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[  894.652378] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  894.774502] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  894.882030] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: f19f4a44-cae7-4ce1-ae57-a6155c93ed54] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[  894.909474] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.081s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  894.936511] env[65478]: INFO nova.scheduler.client.report [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Deleted allocations for instance d978e71d-2c30-4a76-b000-6ddf3203ab10
[  895.055607] env[65478]: DEBUG oslo_vmware.api [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lease: (returnval){
[  895.055607] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c93e36-de2f-5880-a6c0-e3de0c5b7642"
[  895.055607] env[65478]:    _type = "HttpNfcLease"
[  895.055607] env[65478]:  } is ready. {{(pid=65478) _poll_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:487}}
[  895.055607] env[65478]: DEBUG oslo_vmware.rw_handles [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VIM API for reading info of lease: (returnval){
[  895.055607] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52c93e36-de2f-5880-a6c0-e3de0c5b7642"
[  895.055607] env[65478]:    _type = "HttpNfcLease"
[  895.055607] env[65478]:  }. {{(pid=65478) _create_export_vm_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:486}}
[  895.055607] env[65478]: DEBUG oslo_vmware.service [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f650cada-841d-48f8-a58f-442801840273 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  895.063525] env[65478]: DEBUG oslo_vmware.rw_handles [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Found VMDK URL: https://esx7c1n3.openstack.eu-de-1.cloud.sap/nfc/520c017b-f557-9369-ed71-85d3404bab84/disk-0.vmdk from lease info. {{(pid=65478) _find_vmdk_url /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:531}}
[  895.064030] env[65478]: DEBUG oslo_vmware.rw_handles [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Opening URL: https://esx7c1n3.openstack.eu-de-1.cloud.sap/nfc/520c017b-f557-9369-ed71-85d3404bab84/disk-0.vmdk for reading. {{(pid=65478) _create_read_connection /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:99}}
[  895.184563] env[65478]: DEBUG oslo_vmware.service [-] Invoking HttpNfcLease.HttpNfcLeaseProgress with opID=oslo.vmware-e44e43e2-2e9a-4010-b1b3-64c3dd0c5f5c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  895.190950] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'oslo_vmware.rw_handles.VmdkHandle.update_progress' sleeping for 59.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[  895.384647] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: 79200ab1-07f5-48a8-b2f0-b670852df5a0] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[  895.445777] env[65478]: DEBUG oslo_concurrency.lockutils [None req-e50383f1-3bca-4d75-8f34-88031cb1709e tempest-AttachInterfacesUnderV243Test-1531497692 tempest-AttachInterfacesUnderV243Test-1531497692-project-member] Lock "d978e71d-2c30-4a76-b000-6ddf3203ab10" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.431s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  895.888559] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: caf7856c-4e51-4e6c-ad32-2088e15d5d8f] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[  896.395725] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  896.397050] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Cleaning up deleted instances with incomplete migration  {{(pid=65478) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11998}}
[  896.530429] env[65478]: DEBUG nova.network.neutron [-] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  896.899542] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  897.039555] env[65478]: INFO nova.compute.manager [-] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Took 2.39 seconds to deallocate network for instance.
[  897.154681] env[65478]: DEBUG nova.compute.manager [req-6afaa459-af9c-43ce-915f-16838822323c req-f04cf36e-5f93-4547-af02-f65d3a74263a service nova] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Received event network-vif-deleted-2adf13cf-99c3-472f-bc02-769c66b01c29 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  897.366481] env[65478]: WARNING nova.utils [None req-00650e1e-b10f-4a30-9140-84874f1c176f tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d92033ac20> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  897.402687] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[  897.548614] env[65478]: DEBUG oslo_concurrency.lockutils [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  897.548902] env[65478]: DEBUG oslo_concurrency.lockutils [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  897.549090] env[65478]: DEBUG nova.objects.instance [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Lazy-loading 'resources' on Instance uuid fbf21f21-d370-4a6a-ae24-0e6840464e24 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  898.342278] env[65478]: WARNING nova.utils [None req-478e71d8-a475-456f-a1d0-57529cb2e1a5 tempest-InstanceActionsNegativeTestJSON-1643230737 tempest-InstanceActionsNegativeTestJSON-1643230737-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8fc468160> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  898.617248] env[65478]: DEBUG oslo_vmware.service [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-36a64f70-b597-4564-a067-feb01176f7c5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  898.624861] env[65478]: DEBUG oslo_vmware.service [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-bdb0b02e-28df-46fe-bc44-94365b5c04db {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  898.658655] env[65478]: DEBUG oslo_vmware.service [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-7dc089f7-64ac-4c26-b2f9-3ea4a93d448f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  898.665576] env[65478]: DEBUG oslo_vmware.service [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-2681cefc-bc54-454e-b6d6-ca7b2e53d0ae {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  898.679567] env[65478]: DEBUG nova.compute.provider_tree [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  899.183295] env[65478]: DEBUG nova.scheduler.client.report [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  899.689262] env[65478]: DEBUG oslo_concurrency.lockutils [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.140s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  899.756322] env[65478]: INFO nova.scheduler.client.report [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Deleted allocations for instance fbf21f21-d370-4a6a-ae24-0e6840464e24
[  900.270127] env[65478]: DEBUG oslo_concurrency.lockutils [None req-eaf9c2c7-d3ab-4e0b-8f38-5f7fba5245e5 tempest-ServersV294TestFqdnHostnames-672593495 tempest-ServersV294TestFqdnHostnames-672593495-project-member] Lock "fbf21f21-d370-4a6a-ae24-0e6840464e24" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.231s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  901.702609] env[65478]: WARNING nova.utils [None req-40b8e94a-5d7a-4feb-b4f0-02ce8e63444a tempest-ServerAddressesTestJSON-810969210 tempest-ServerAddressesTestJSON-810969210-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8fc73ed40> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  901.934626] env[65478]: DEBUG oslo_concurrency.lockutils [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Acquiring lock "78246782-d2a2-4819-8924-51764ffe05aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  901.934834] env[65478]: DEBUG oslo_concurrency.lockutils [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Lock "78246782-d2a2-4819-8924-51764ffe05aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  901.935080] env[65478]: DEBUG oslo_concurrency.lockutils [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Acquiring lock "78246782-d2a2-4819-8924-51764ffe05aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  901.935216] env[65478]: DEBUG oslo_concurrency.lockutils [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Lock "78246782-d2a2-4819-8924-51764ffe05aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  901.935347] env[65478]: DEBUG oslo_concurrency.lockutils [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Lock "78246782-d2a2-4819-8924-51764ffe05aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  901.937671] env[65478]: INFO nova.compute.manager [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Terminating instance
[  902.441649] env[65478]: DEBUG nova.compute.manager [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[  902.441954] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  902.443069] env[65478]: DEBUG oslo_vmware.service [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8a657fc4-8837-403f-aae8-e4592a40bfd7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  902.451672] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  902.451840] env[65478]: DEBUG oslo_vmware.service [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-0d1e642e-75a0-4faf-a3d8-33c17b528677 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  902.459256] env[65478]: DEBUG oslo_vmware.api [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Waiting for the task: (returnval){
[  902.459256] env[65478]:    value = "task-6011865"
[  902.459256] env[65478]:    _type = "Task"
[  902.459256] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  902.468279] env[65478]: DEBUG oslo_vmware.api [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Task: {'id': task-6011865, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  902.618964] env[65478]: DEBUG oslo_vmware.rw_handles [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Getting lease state for https://esx7c1n3.openstack.eu-de-1.cloud.sap/nfc/520c017b-f557-9369-ed71-85d3404bab84/disk-0.vmdk. {{(pid=65478) _release_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:423}}
[  902.619914] env[65478]: DEBUG oslo_vmware.service [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6280757a-0ee2-4a6a-b937-78c3ef34df4f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  902.627858] env[65478]: DEBUG oslo_vmware.rw_handles [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lease for https://esx7c1n3.openstack.eu-de-1.cloud.sap/nfc/520c017b-f557-9369-ed71-85d3404bab84/disk-0.vmdk is in state: ready. {{(pid=65478) _release_lease /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:430}}
[  902.627858] env[65478]: ERROR oslo_vmware.rw_handles [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Aborting lease for https://esx7c1n3.openstack.eu-de-1.cloud.sap/nfc/520c017b-f557-9369-ed71-85d3404bab84/disk-0.vmdk due to incomplete transfer.
[  902.627858] env[65478]: DEBUG oslo_vmware.service [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking HttpNfcLease.HttpNfcLeaseAbort with opID=oslo.vmware-37763aee-eb32-428b-a263-b6cbddfc6378 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  902.632464] env[65478]: DEBUG oslo_vmware.rw_handles [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Closed VMDK read handle for https://esx7c1n3.openstack.eu-de-1.cloud.sap/nfc/520c017b-f557-9369-ed71-85d3404bab84/disk-0.vmdk. {{(pid=65478) close /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/rw_handles.py:735}}
[  902.632740] env[65478]: DEBUG nova.virt.vmwareapi.images [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Uploaded image 1d1dd84d-7c54-45d2-ace2-3da053a8ae54 to the Glance image server {{(pid=65478) upload_image_stream_optimized /opt/stack/nova/nova/virt/vmwareapi/images.py:472}}
[  902.634109] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Destroying the VM {{(pid=65478) destroy_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1368}}
[  902.634587] env[65478]: DEBUG oslo_vmware.service [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualMachine.Destroy_Task with opID=oslo.vmware-95623eb3-890f-4a01-b057-547eb416c5f0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  902.640479] env[65478]: DEBUG oslo_vmware.api [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  902.640479] env[65478]:    value = "task-6011866"
[  902.640479] env[65478]:    _type = "Task"
[  902.640479] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  902.649624] env[65478]: DEBUG oslo_vmware.api [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011866, 'name': Destroy_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  902.969676] env[65478]: DEBUG oslo_vmware.api [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Task: {'id': task-6011865, 'name': PowerOffVM_Task, 'duration_secs': 0.280524} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  902.970466] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  902.972651] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  902.972651] env[65478]: DEBUG oslo_vmware.service [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-38a1131b-8494-40fd-a2cf-ff77675d23ad {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  903.055471] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  903.055649] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Deleting contents of the VM from datastore datastore2 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  903.055811] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Deleting the datastore file [datastore2] 78246782-d2a2-4819-8924-51764ffe05aa {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  903.056589] env[65478]: DEBUG oslo_vmware.service [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-1699f456-ff51-4a9b-b6ca-f50f7a92abe3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  903.065454] env[65478]: DEBUG oslo_vmware.api [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Waiting for the task: (returnval){
[  903.065454] env[65478]:    value = "task-6011868"
[  903.065454] env[65478]:    _type = "Task"
[  903.065454] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  903.073343] env[65478]: DEBUG oslo_vmware.api [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Task: {'id': task-6011868, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  903.155651] env[65478]: DEBUG oslo_vmware.api [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011866, 'name': Destroy_Task} progress is 33%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  903.581609] env[65478]: DEBUG oslo_vmware.api [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Task: {'id': task-6011868, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.136958} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  903.581817] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  903.582028] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Deleted contents of the VM from datastore datastore2 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  903.582193] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  903.583099] env[65478]: INFO nova.compute.manager [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Took 1.14 seconds to destroy the instance on the hypervisor.
[  903.583613] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  903.586373] env[65478]: DEBUG nova.compute.manager [-] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[  903.586373] env[65478]: DEBUG nova.network.neutron [-] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[  903.586373] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  903.654284] env[65478]: DEBUG oslo_vmware.api [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011866, 'name': Destroy_Task, 'duration_secs': 0.6261} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  903.654518] env[65478]: INFO nova.virt.vmwareapi.vm_util [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Destroyed the VM
[  903.654823] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Deleting Snapshot of the VM instance {{(pid=65478) _delete_vm_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:932}}
[  903.655095] env[65478]: DEBUG oslo_vmware.service [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualMachineSnapshot.RemoveSnapshot_Task with opID=oslo.vmware-a95a17b2-a730-47db-a65a-11a7691bd309 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  903.662071] env[65478]: DEBUG oslo_vmware.api [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  903.662071] env[65478]:    value = "task-6011869"
[  903.662071] env[65478]:    _type = "Task"
[  903.662071] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  903.670688] env[65478]: DEBUG oslo_vmware.api [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011869, 'name': RemoveSnapshot_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  903.966889] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  904.175133] env[65478]: DEBUG oslo_vmware.api [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011869, 'name': RemoveSnapshot_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  904.675559] env[65478]: DEBUG oslo_vmware.api [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011869, 'name': RemoveSnapshot_Task, 'duration_secs': 0.883395} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  904.675931] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Deleted Snapshot of the VM instance {{(pid=65478) _delete_vm_snapshot /opt/stack/nova/nova/virt/vmwareapi/vmops.py:938}}
[  904.676232] env[65478]: INFO nova.compute.manager [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Took 15.30 seconds to snapshot the instance on the hypervisor.
[  905.252871] env[65478]: DEBUG nova.compute.manager [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Found 3 images (rotation: 2) {{(pid=65478) _rotate_backups /opt/stack/nova/nova/compute/manager.py:5098}}
[  905.253176] env[65478]: DEBUG nova.compute.manager [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Rotating out 1 backups {{(pid=65478) _rotate_backups /opt/stack/nova/nova/compute/manager.py:5106}}
[  905.254824] env[65478]: DEBUG nova.network.neutron [-] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  905.256028] env[65478]: DEBUG nova.compute.manager [None req-def58cec-3eea-4997-8cd8-e35703002fd2 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Deleting image c9f40f18-b301-41ed-99ed-46614a14a522 {{(pid=65478) _rotate_backups /opt/stack/nova/nova/compute/manager.py:5111}}
[  905.672814] env[65478]: DEBUG nova.compute.manager [req-1766b9e9-64fa-4aad-a11f-c4ceb88c9629 req-a101eaf9-359e-4efa-a6cd-74ba00b70a73 service nova] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Received event network-vif-deleted-09df3109-08b1-49d4-8a44-1f111fb53582 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  905.760648] env[65478]: INFO nova.compute.manager [-] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Took 2.18 seconds to deallocate network for instance.
[  906.272742] env[65478]: DEBUG oslo_concurrency.lockutils [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  906.273774] env[65478]: DEBUG oslo_concurrency.lockutils [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  906.273973] env[65478]: DEBUG nova.objects.instance [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Lazy-loading 'resources' on Instance uuid 78246782-d2a2-4819-8924-51764ffe05aa {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  907.179690] env[65478]: WARNING nova.utils [None req-a96e0d3f-111d-43e7-a175-7bd068366cfe tempest-ServerAddressesNegativeTestJSON-1561649537 tempest-ServerAddressesNegativeTestJSON-1561649537-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8fc4684c0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  907.399405] env[65478]: DEBUG oslo_vmware.service [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-95887eee-0828-47d3-be70-007f5d33e9ee {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  907.407821] env[65478]: DEBUG oslo_vmware.service [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6a8efd54-2c97-4fc2-acf7-061752934bef {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  907.455561] env[65478]: DEBUG oslo_vmware.service [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4feb96bc-eaf3-4f9e-876f-c34cff2c4275 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  907.468981] env[65478]: DEBUG oslo_vmware.service [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b58fdde7-7a31-44dc-bc44-0f507707228e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  907.483695] env[65478]: DEBUG nova.compute.provider_tree [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  907.987038] env[65478]: DEBUG nova.scheduler.client.report [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  908.007056] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c94f17b6-4895-48fc-90e9-f1e3efc241ec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Acquiring lock "9b286a00-af27-4012-a596-45bbe98da254" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  908.007474] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c94f17b6-4895-48fc-90e9-f1e3efc241ec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lock "9b286a00-af27-4012-a596-45bbe98da254" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  908.008619] env[65478]: DEBUG nova.compute.manager [None req-c94f17b6-4895-48fc-90e9-f1e3efc241ec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  908.009229] env[65478]: DEBUG oslo_vmware.service [None req-c94f17b6-4895-48fc-90e9-f1e3efc241ec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-010ee60c-1e38-46ac-88a3-09ef16f83966 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  908.016035] env[65478]: DEBUG nova.compute.manager [None req-c94f17b6-4895-48fc-90e9-f1e3efc241ec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=65478) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3483}}
[  908.016525] env[65478]: DEBUG nova.objects.instance [None req-c94f17b6-4895-48fc-90e9-f1e3efc241ec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lazy-loading 'flavor' on Instance uuid 9b286a00-af27-4012-a596-45bbe98da254 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  908.491883] env[65478]: DEBUG oslo_concurrency.lockutils [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.218s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  908.514960] env[65478]: INFO nova.scheduler.client.report [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Deleted allocations for instance 78246782-d2a2-4819-8924-51764ffe05aa
[  909.026633] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-c94f17b6-4895-48fc-90e9-f1e3efc241ec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  909.027026] env[65478]: DEBUG oslo_vmware.service [None req-c94f17b6-4895-48fc-90e9-f1e3efc241ec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-48220ad8-6ada-45d5-9cd9-c7bba6ffed27 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  909.029633] env[65478]: DEBUG oslo_concurrency.lockutils [None req-70a58db5-b9d4-415f-a325-0b73ecc33cbd tempest-ServersTestFqdnHostnames-1317685366 tempest-ServersTestFqdnHostnames-1317685366-project-member] Lock "78246782-d2a2-4819-8924-51764ffe05aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.093s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  909.035335] env[65478]: DEBUG oslo_vmware.api [None req-c94f17b6-4895-48fc-90e9-f1e3efc241ec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  909.035335] env[65478]:    value = "task-6011870"
[  909.035335] env[65478]:    _type = "Task"
[  909.035335] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  909.045647] env[65478]: DEBUG oslo_vmware.api [None req-c94f17b6-4895-48fc-90e9-f1e3efc241ec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011870, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  909.545147] env[65478]: DEBUG oslo_vmware.api [None req-c94f17b6-4895-48fc-90e9-f1e3efc241ec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011870, 'name': PowerOffVM_Task, 'duration_secs': 0.191063} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  909.545627] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-c94f17b6-4895-48fc-90e9-f1e3efc241ec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  909.545627] env[65478]: DEBUG nova.compute.manager [None req-c94f17b6-4895-48fc-90e9-f1e3efc241ec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  909.546318] env[65478]: DEBUG oslo_vmware.service [None req-c94f17b6-4895-48fc-90e9-f1e3efc241ec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-97686e83-9284-4a75-8cca-fa6b233f0b1a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  910.057908] env[65478]: DEBUG oslo_concurrency.lockutils [None req-c94f17b6-4895-48fc-90e9-f1e3efc241ec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lock "9b286a00-af27-4012-a596-45bbe98da254" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.050s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  911.363105] env[65478]: DEBUG nova.compute.manager [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Stashing vm_state: stopped {{(pid=65478) _prep_resize /opt/stack/nova/nova/compute/manager.py:6217}}
[  911.884401] env[65478]: DEBUG oslo_concurrency.lockutils [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  911.884763] env[65478]: DEBUG oslo_concurrency.lockutils [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  912.389635] env[65478]: INFO nova.compute.claims [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Claim successful on node domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28
[  912.895784] env[65478]: INFO nova.compute.resource_tracker [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Updating resource usage from migration 33aa3e9e-7d65-430f-90db-60f47ad2771b
[  913.413930] env[65478]: DEBUG oslo_vmware.service [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-37a9f8df-e87e-4261-9afe-2a6963a0f5b8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  913.421685] env[65478]: DEBUG oslo_vmware.service [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-cefcd87a-980d-4dde-b018-a617e9f65596 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  913.453387] env[65478]: DEBUG oslo_vmware.service [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-53cf4d3f-22ac-4ce9-a2bf-5eb343cc7864 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  913.460329] env[65478]: DEBUG oslo_vmware.service [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c4d3d183-c8c8-450c-bdbb-1445bb60fe02 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  913.473555] env[65478]: DEBUG nova.compute.provider_tree [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  913.976699] env[65478]: DEBUG nova.scheduler.client.report [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  914.481477] env[65478]: DEBUG oslo_concurrency.lockutils [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.597s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  914.481730] env[65478]: INFO nova.compute.manager [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Migrating
[  915.000051] env[65478]: DEBUG oslo_concurrency.lockutils [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Acquiring lock "refresh_cache-9b286a00-af27-4012-a596-45bbe98da254" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  915.000224] env[65478]: DEBUG oslo_concurrency.lockutils [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Acquired lock "refresh_cache-9b286a00-af27-4012-a596-45bbe98da254" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  915.001742] env[65478]: DEBUG nova.network.neutron [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  915.502674] env[65478]: WARNING neutronclient.v2_0.client [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  915.712017] env[65478]: WARNING neutronclient.v2_0.client [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  915.797899] env[65478]: DEBUG nova.network.neutron [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Updating instance_info_cache with network_info: [{"id": "fc5c04e7-8dac-4f1f-a5e4-9f9d31498143", "address": "fa:16:3e:17:84:6e", "network": {"id": "7cd93ed0-202b-4b24-a579-dd5eacc8ea60", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140861423-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "10.180.180.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "3c6c9b0fcb1f453a8108522a8924bda3", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "d4345ef6-a7c8-4c1c-badf-a0d4f578b61c", "external-id": "nsx-vlan-transportzone-677", "segmentation_id": 677, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapfc5c04e7-8d", "ovs_interfaceid": "fc5c04e7-8dac-4f1f-a5e4-9f9d31498143", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  916.300859] env[65478]: DEBUG oslo_concurrency.lockutils [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Releasing lock "refresh_cache-9b286a00-af27-4012-a596-45bbe98da254" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  916.544441] env[65478]: WARNING nova.utils [None req-86eb6af0-f245-484b-8a58-2fd1627305ee tempest-ServersTestMultiNic-907351750 tempest-ServersTestMultiNic-907351750-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d92033b1c0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  917.818584] env[65478]: DEBUG oslo_vmware.service [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d806eff3-3bbd-40d4-9b84-7bc2c37493fc {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  917.840363] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Updating instance '9b286a00-af27-4012-a596-45bbe98da254' progress to 0 {{(pid=65478) _update_instance_progress /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1352}}
[  918.349415] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  918.349752] env[65478]: DEBUG oslo_vmware.service [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-33b3be50-5006-4404-a64a-be866960ad56 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  918.357027] env[65478]: DEBUG oslo_vmware.api [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  918.357027] env[65478]:    value = "task-6011871"
[  918.357027] env[65478]:    _type = "Task"
[  918.357027] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  918.363755] env[65478]: DEBUG oslo_vmware.api [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011871, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  918.866562] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] VM already powered off {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1519}}
[  918.866890] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Updating instance '9b286a00-af27-4012-a596-45bbe98da254' progress to 17 {{(pid=65478) _update_instance_progress /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1352}}
[  919.373097] env[65478]: DEBUG nova.virt.hardware [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  919.373321] env[65478]: DEBUG nova.virt.hardware [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  919.373437] env[65478]: DEBUG nova.virt.hardware [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  919.373578] env[65478]: DEBUG nova.virt.hardware [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  919.373683] env[65478]: DEBUG nova.virt.hardware [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  919.373788] env[65478]: DEBUG nova.virt.hardware [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  919.373960] env[65478]: DEBUG nova.virt.hardware [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  919.374089] env[65478]: DEBUG nova.virt.hardware [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  919.374258] env[65478]: DEBUG nova.virt.hardware [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  919.374392] env[65478]: DEBUG nova.virt.hardware [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  919.374527] env[65478]: DEBUG nova.virt.hardware [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  919.380046] env[65478]: DEBUG oslo_vmware.service [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-9771abfc-569d-4cf8-99c5-ef69a3f0636d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  919.396263] env[65478]: DEBUG oslo_vmware.api [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  919.396263] env[65478]:    value = "task-6011872"
[  919.396263] env[65478]:    _type = "Task"
[  919.396263] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  919.404685] env[65478]: DEBUG oslo_vmware.api [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011872, 'name': ReconfigVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  919.911361] env[65478]: DEBUG oslo_vmware.api [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011872, 'name': ReconfigVM_Task, 'duration_secs': 0.137151} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  919.911695] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Updating instance '9b286a00-af27-4012-a596-45bbe98da254' progress to 33 {{(pid=65478) _update_instance_progress /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1352}}
[  920.418182] env[65478]: DEBUG nova.virt.hardware [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[  920.418409] env[65478]: DEBUG nova.virt.hardware [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[  920.418530] env[65478]: DEBUG nova.virt.hardware [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[  920.418676] env[65478]: DEBUG nova.virt.hardware [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[  920.418778] env[65478]: DEBUG nova.virt.hardware [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[  920.419082] env[65478]: DEBUG nova.virt.hardware [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[  920.419082] env[65478]: DEBUG nova.virt.hardware [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[  920.419264] env[65478]: DEBUG nova.virt.hardware [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[  920.419325] env[65478]: DEBUG nova.virt.hardware [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[  920.421037] env[65478]: DEBUG nova.virt.hardware [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[  920.421037] env[65478]: DEBUG nova.virt.hardware [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[  920.425376] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Reconfiguring VM instance instance-0000001a to detach disk 2000 {{(pid=65478) detach_disk_from_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:122}}
[  920.425552] env[65478]: DEBUG oslo_vmware.service [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-d0c9f645-5484-409d-a39e-7dff7abfb324 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  920.444039] env[65478]: DEBUG oslo_vmware.api [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  920.444039] env[65478]:    value = "task-6011873"
[  920.444039] env[65478]:    _type = "Task"
[  920.444039] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  920.451941] env[65478]: DEBUG oslo_vmware.api [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011873, 'name': ReconfigVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  920.953874] env[65478]: DEBUG oslo_vmware.api [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011873, 'name': ReconfigVM_Task, 'duration_secs': 0.151797} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  920.954195] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Reconfigured VM instance instance-0000001a to detach disk 2000 {{(pid=65478) detach_disk_from_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:127}}
[  920.955267] env[65478]: DEBUG oslo_vmware.service [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-598d66c9-7321-4c1f-b3fd-671353e3eba0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  920.978229] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Reconfiguring VM instance instance-0000001a to attach disk [datastore2] 9b286a00-af27-4012-a596-45bbe98da254/9b286a00-af27-4012-a596-45bbe98da254.vmdk or device None with type thin {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[  920.978603] env[65478]: DEBUG oslo_vmware.service [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-c327b564-d0ba-48b8-82ea-ceef6b42b74c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  920.997318] env[65478]: DEBUG oslo_vmware.api [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  920.997318] env[65478]:    value = "task-6011874"
[  920.997318] env[65478]:    _type = "Task"
[  920.997318] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  921.005540] env[65478]: DEBUG oslo_vmware.api [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011874, 'name': ReconfigVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  921.507481] env[65478]: DEBUG oslo_vmware.api [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011874, 'name': ReconfigVM_Task, 'duration_secs': 0.251794} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  921.507721] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Reconfigured VM instance instance-0000001a to attach disk [datastore2] 9b286a00-af27-4012-a596-45bbe98da254/9b286a00-af27-4012-a596-45bbe98da254.vmdk or device None with type thin {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[  921.507977] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Updating instance '9b286a00-af27-4012-a596-45bbe98da254' progress to 50 {{(pid=65478) _update_instance_progress /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1352}}
[  922.015159] env[65478]: DEBUG oslo_vmware.service [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-25c73bae-5f33-49b8-a1b4-742f0ca9404d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  922.035709] env[65478]: DEBUG oslo_vmware.service [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-7aa4d978-395c-4217-9fee-c97087e79177 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  922.055697] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Updating instance '9b286a00-af27-4012-a596-45bbe98da254' progress to 67 {{(pid=65478) _update_instance_progress /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1352}}
[  922.561930] env[65478]: WARNING neutronclient.v2_0.client [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  922.562251] env[65478]: WARNING neutronclient.v2_0.client [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  922.597785] env[65478]: DEBUG nova.network.neutron [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Port fc5c04e7-8dac-4f1f-a5e4-9f9d31498143 binding to destination host cpu-1 is already ACTIVE {{(pid=65478) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
[  923.614992] env[65478]: DEBUG oslo_concurrency.lockutils [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Acquiring lock "9b286a00-af27-4012-a596-45bbe98da254-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  923.619878] env[65478]: DEBUG oslo_concurrency.lockutils [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lock "9b286a00-af27-4012-a596-45bbe98da254-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.005s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  923.621303] env[65478]: DEBUG oslo_concurrency.lockutils [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lock "9b286a00-af27-4012-a596-45bbe98da254-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  924.624489] env[65478]: WARNING neutronclient.v2_0.client [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  924.659979] env[65478]: DEBUG oslo_concurrency.lockutils [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Acquiring lock "refresh_cache-9b286a00-af27-4012-a596-45bbe98da254" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  924.660227] env[65478]: DEBUG oslo_concurrency.lockutils [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Acquired lock "refresh_cache-9b286a00-af27-4012-a596-45bbe98da254" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  924.660381] env[65478]: DEBUG nova.network.neutron [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  925.163143] env[65478]: WARNING neutronclient.v2_0.client [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  925.336823] env[65478]: WARNING neutronclient.v2_0.client [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  925.408219] env[65478]: DEBUG nova.network.neutron [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Updating instance_info_cache with network_info: [{"id": "fc5c04e7-8dac-4f1f-a5e4-9f9d31498143", "address": "fa:16:3e:17:84:6e", "network": {"id": "7cd93ed0-202b-4b24-a579-dd5eacc8ea60", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140861423-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "10.180.180.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "3c6c9b0fcb1f453a8108522a8924bda3", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "d4345ef6-a7c8-4c1c-badf-a0d4f578b61c", "external-id": "nsx-vlan-transportzone-677", "segmentation_id": 677, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapfc5c04e7-8d", "ovs_interfaceid": "fc5c04e7-8dac-4f1f-a5e4-9f9d31498143", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  925.912900] env[65478]: DEBUG oslo_concurrency.lockutils [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Releasing lock "refresh_cache-9b286a00-af27-4012-a596-45bbe98da254" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  926.443021] env[65478]: DEBUG oslo_vmware.service [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-69f5b46e-c8a5-4717-b8f2-22d24a18be65 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  926.463035] env[65478]: DEBUG oslo_vmware.service [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a96a7412-fedf-49de-9e29-90ec70b01b4b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  926.470744] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Updating instance '9b286a00-af27-4012-a596-45bbe98da254' progress to 83 {{(pid=65478) _update_instance_progress /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1352}}
[  926.977443] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-3b6bd578-cf70-46b9-924f-ac8840edbeb9 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Updating instance '9b286a00-af27-4012-a596-45bbe98da254' progress to 100 {{(pid=65478) _update_instance_progress /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1352}}
[  928.906629] env[65478]: DEBUG oslo_concurrency.lockutils [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Acquiring lock "9b286a00-af27-4012-a596-45bbe98da254" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  928.906904] env[65478]: DEBUG oslo_concurrency.lockutils [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lock "9b286a00-af27-4012-a596-45bbe98da254" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  928.907019] env[65478]: DEBUG nova.compute.manager [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Going to confirm migration 2 {{(pid=65478) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5331}}
[  929.412696] env[65478]: WARNING neutronclient.v2_0.client [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  929.454127] env[65478]: WARNING neutronclient.v2_0.client [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  929.454470] env[65478]: DEBUG oslo_concurrency.lockutils [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Acquiring lock "refresh_cache-9b286a00-af27-4012-a596-45bbe98da254" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  929.454578] env[65478]: DEBUG oslo_concurrency.lockutils [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Acquired lock "refresh_cache-9b286a00-af27-4012-a596-45bbe98da254" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  929.454709] env[65478]: DEBUG nova.network.neutron [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  929.454849] env[65478]: DEBUG nova.objects.instance [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lazy-loading 'info_cache' on Instance uuid 9b286a00-af27-4012-a596-45bbe98da254 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  930.461594] env[65478]: WARNING neutronclient.v2_0.client [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  930.631170] env[65478]: WARNING neutronclient.v2_0.client [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  930.699582] env[65478]: DEBUG nova.network.neutron [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Updating instance_info_cache with network_info: [{"id": "fc5c04e7-8dac-4f1f-a5e4-9f9d31498143", "address": "fa:16:3e:17:84:6e", "network": {"id": "7cd93ed0-202b-4b24-a579-dd5eacc8ea60", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140861423-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "10.180.180.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "3c6c9b0fcb1f453a8108522a8924bda3", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "d4345ef6-a7c8-4c1c-badf-a0d4f578b61c", "external-id": "nsx-vlan-transportzone-677", "segmentation_id": 677, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapfc5c04e7-8d", "ovs_interfaceid": "fc5c04e7-8dac-4f1f-a5e4-9f9d31498143", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  931.201686] env[65478]: DEBUG oslo_concurrency.lockutils [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Releasing lock "refresh_cache-9b286a00-af27-4012-a596-45bbe98da254" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  931.201895] env[65478]: DEBUG nova.objects.instance [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lazy-loading 'migration_context' on Instance uuid 9b286a00-af27-4012-a596-45bbe98da254 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  931.704852] env[65478]: DEBUG nova.objects.base [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Object Instance<9b286a00-af27-4012-a596-45bbe98da254> lazy-loaded attributes: info_cache,migration_context {{(pid=65478) wrapper /opt/stack/nova/nova/objects/base.py:136}}
[  931.705892] env[65478]: DEBUG oslo_vmware.service [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-2bc6aaaf-2121-400d-8687-ae141ec200cd {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  931.726531] env[65478]: DEBUG oslo_vmware.service [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-597e9384-7cf4-4fb3-b083-5ccb173801f1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  931.731981] env[65478]: DEBUG oslo_vmware.api [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  931.731981] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]520ac74c-4987-80dd-23b1-3457f0e50265"
[  931.731981] env[65478]:    _type = "Task"
[  931.731981] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  931.739931] env[65478]: DEBUG oslo_vmware.api [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]520ac74c-4987-80dd-23b1-3457f0e50265, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  932.241336] env[65478]: DEBUG oslo_vmware.api [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]520ac74c-4987-80dd-23b1-3457f0e50265, 'name': SearchDatastore_Task, 'duration_secs': 0.006398} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  932.241587] env[65478]: DEBUG oslo_concurrency.lockutils [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  932.241771] env[65478]: DEBUG oslo_concurrency.lockutils [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  933.183459] env[65478]: DEBUG oslo_vmware.service [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6ec0847f-6ab0-4762-9765-22bd74647173 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  933.191038] env[65478]: DEBUG oslo_vmware.service [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3c5b0d21-193e-42de-982c-63ce17d44377 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  933.223931] env[65478]: DEBUG oslo_vmware.service [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e0991524-33c2-4e94-a171-09a6d8b43129 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  933.232838] env[65478]: DEBUG oslo_vmware.service [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e06eb141-f38b-4e9b-8232-007525f0466b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  933.248760] env[65478]: DEBUG nova.compute.provider_tree [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  933.751468] env[65478]: DEBUG nova.scheduler.client.report [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  934.761669] env[65478]: DEBUG oslo_concurrency.lockutils [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.520s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  934.761933] env[65478]: DEBUG nova.compute.manager [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Resized/migrated instance is powered off. Setting vm_state to 'stopped'. {{(pid=65478) _confirm_resize /opt/stack/nova/nova/compute/manager.py:5457}}
[  935.334914] env[65478]: INFO nova.scheduler.client.report [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Deleted allocation for migration 33aa3e9e-7d65-430f-90db-60f47ad2771b
[  935.841180] env[65478]: DEBUG oslo_concurrency.lockutils [None req-3888a456-8754-4510-8032-ccfc2b1283ce tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lock "9b286a00-af27-4012-a596-45bbe98da254" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 6.934s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  936.154668] env[65478]: DEBUG nova.objects.instance [None req-96903d4c-ff6e-41a8-9692-604086922945 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lazy-loading 'flavor' on Instance uuid 9b286a00-af27-4012-a596-45bbe98da254 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  936.659550] env[65478]: DEBUG oslo_concurrency.lockutils [None req-96903d4c-ff6e-41a8-9692-604086922945 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Acquiring lock "refresh_cache-9b286a00-af27-4012-a596-45bbe98da254" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[  936.659747] env[65478]: DEBUG oslo_concurrency.lockutils [None req-96903d4c-ff6e-41a8-9692-604086922945 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Acquired lock "refresh_cache-9b286a00-af27-4012-a596-45bbe98da254" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[  936.659818] env[65478]: DEBUG nova.network.neutron [None req-96903d4c-ff6e-41a8-9692-604086922945 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Building network info cache for instance {{(pid=65478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
[  936.659927] env[65478]: DEBUG nova.objects.instance [None req-96903d4c-ff6e-41a8-9692-604086922945 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lazy-loading 'info_cache' on Instance uuid 9b286a00-af27-4012-a596-45bbe98da254 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[  937.162855] env[65478]: DEBUG nova.objects.base [None req-96903d4c-ff6e-41a8-9692-604086922945 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Object Instance<9b286a00-af27-4012-a596-45bbe98da254> lazy-loaded attributes: flavor,info_cache {{(pid=65478) wrapper /opt/stack/nova/nova/objects/base.py:136}}
[  937.665547] env[65478]: WARNING neutronclient.v2_0.client [None req-96903d4c-ff6e-41a8-9692-604086922945 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  937.839738] env[65478]: WARNING neutronclient.v2_0.client [None req-96903d4c-ff6e-41a8-9692-604086922945 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  937.906916] env[65478]: DEBUG nova.network.neutron [None req-96903d4c-ff6e-41a8-9692-604086922945 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Updating instance_info_cache with network_info: [{"id": "fc5c04e7-8dac-4f1f-a5e4-9f9d31498143", "address": "fa:16:3e:17:84:6e", "network": {"id": "7cd93ed0-202b-4b24-a579-dd5eacc8ea60", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140861423-network", "subnets": [{"cidr": "192.168.128.0/28", "dns": [], "gateway": {"address": "192.168.128.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.128.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "10.180.180.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true, "dhcp_server": "192.168.128.2"}}], "meta": {"injected": false, "tenant_id": "3c6c9b0fcb1f453a8108522a8924bda3", "mtu": 8950, "physical_network": "default", "tunneled": false}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "nsx-logical-switch-id": "d4345ef6-a7c8-4c1c-badf-a0d4f578b61c", "external-id": "nsx-vlan-transportzone-677", "segmentation_id": 677, "bound_drivers": {"0": "nsxv3"}}, "devname": "tapfc5c04e7-8d", "ovs_interfaceid": "fc5c04e7-8dac-4f1f-a5e4-9f9d31498143", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  938.410713] env[65478]: DEBUG oslo_concurrency.lockutils [None req-96903d4c-ff6e-41a8-9692-604086922945 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Releasing lock "refresh_cache-9b286a00-af27-4012-a596-45bbe98da254" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[  939.415521] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-96903d4c-ff6e-41a8-9692-604086922945 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[  939.416410] env[65478]: DEBUG oslo_vmware.service [None req-96903d4c-ff6e-41a8-9692-604086922945 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-27918083-2a86-4627-9ae7-29339941f44f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  939.422890] env[65478]: DEBUG oslo_vmware.api [None req-96903d4c-ff6e-41a8-9692-604086922945 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  939.422890] env[65478]:    value = "task-6011875"
[  939.422890] env[65478]:    _type = "Task"
[  939.422890] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  939.430800] env[65478]: DEBUG oslo_vmware.api [None req-96903d4c-ff6e-41a8-9692-604086922945 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011875, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  939.932187] env[65478]: DEBUG oslo_vmware.api [None req-96903d4c-ff6e-41a8-9692-604086922945 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011875, 'name': PowerOnVM_Task, 'duration_secs': 0.397348} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  939.932485] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-96903d4c-ff6e-41a8-9692-604086922945 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[  939.932644] env[65478]: DEBUG nova.compute.manager [None req-96903d4c-ff6e-41a8-9692-604086922945 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[  939.933489] env[65478]: DEBUG oslo_vmware.service [None req-96903d4c-ff6e-41a8-9692-604086922945 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-509faf6d-bd39-43a1-9f3e-2fa5c4934130 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  940.877036] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Acquiring lock "9b286a00-af27-4012-a596-45bbe98da254" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  940.877036] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lock "9b286a00-af27-4012-a596-45bbe98da254" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  940.877473] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Acquiring lock "9b286a00-af27-4012-a596-45bbe98da254-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  940.877473] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lock "9b286a00-af27-4012-a596-45bbe98da254-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  940.877562] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lock "9b286a00-af27-4012-a596-45bbe98da254-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  940.880474] env[65478]: INFO nova.compute.manager [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Terminating instance
[  941.384037] env[65478]: DEBUG nova.compute.manager [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[  941.384037] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[  941.385072] env[65478]: DEBUG oslo_vmware.service [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ede34c8a-6e8d-4823-b2f7-ec6c5d476840 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  941.392347] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[  941.392606] env[65478]: DEBUG oslo_vmware.service [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-88ab9f51-2f89-4290-b2d5-19f462ad1e08 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  941.397772] env[65478]: DEBUG oslo_vmware.api [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  941.397772] env[65478]:    value = "task-6011876"
[  941.397772] env[65478]:    _type = "Task"
[  941.397772] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  941.406451] env[65478]: DEBUG oslo_vmware.api [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011876, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  941.907836] env[65478]: DEBUG oslo_vmware.api [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011876, 'name': PowerOffVM_Task, 'duration_secs': 0.165512} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  941.908131] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[  941.908131] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[  941.908589] env[65478]: DEBUG oslo_vmware.service [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-061532fa-7d49-4ae8-a5ca-522c5c40aee3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  941.965313] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[  941.965493] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Deleting contents of the VM from datastore datastore2 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[  941.965602] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Deleting the datastore file [datastore2] 9b286a00-af27-4012-a596-45bbe98da254 {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[  941.965849] env[65478]: DEBUG oslo_vmware.service [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-3051a9cf-3dbb-4fac-9f35-fce73b1b773a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  941.971531] env[65478]: DEBUG oslo_vmware.api [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for the task: (returnval){
[  941.971531] env[65478]:    value = "task-6011878"
[  941.971531] env[65478]:    _type = "Task"
[  941.971531] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[  941.979450] env[65478]: DEBUG oslo_vmware.api [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011878, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[  942.480594] env[65478]: DEBUG oslo_vmware.api [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Task: {'id': task-6011878, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.14361} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[  942.480807] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[  942.480956] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Deleted contents of the VM from datastore datastore2 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[  942.481113] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[  942.481245] env[65478]: INFO nova.compute.manager [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Took 1.10 seconds to destroy the instance on the hypervisor.
[  942.481776] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[  942.482041] env[65478]: DEBUG nova.compute.manager [-] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[  942.482200] env[65478]: DEBUG nova.network.neutron [-] [instance: 9b286a00-af27-4012-a596-45bbe98da254] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[  942.482481] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  942.539222] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[  942.967613] env[65478]: DEBUG nova.compute.manager [req-0dfcef7c-bdbe-4fff-ab56-0a8164a1f31f req-b57c4800-86e4-4a5b-939e-abbf5b73bf59 service nova] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Received event network-vif-deleted-fc5c04e7-8dac-4f1f-a5e4-9f9d31498143 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[  942.967916] env[65478]: INFO nova.compute.manager [req-0dfcef7c-bdbe-4fff-ab56-0a8164a1f31f req-b57c4800-86e4-4a5b-939e-abbf5b73bf59 service nova] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Neutron deleted interface fc5c04e7-8dac-4f1f-a5e4-9f9d31498143; detaching it from the instance and deleting it from the info cache
[  942.967916] env[65478]: DEBUG nova.network.neutron [req-0dfcef7c-bdbe-4fff-ab56-0a8164a1f31f req-b57c4800-86e4-4a5b-939e-abbf5b73bf59 service nova] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  943.448391] env[65478]: DEBUG nova.network.neutron [-] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[  943.471480] env[65478]: DEBUG oslo_vmware.service [req-0dfcef7c-bdbe-4fff-ab56-0a8164a1f31f req-b57c4800-86e4-4a5b-939e-abbf5b73bf59 service nova] Invoking SearchIndex.FindAllByUuid with opID=oslo.vmware-520e8f14-c65d-4420-9581-a24edec114e2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  943.480136] env[65478]: DEBUG oslo_vmware.service [req-0dfcef7c-bdbe-4fff-ab56-0a8164a1f31f req-b57c4800-86e4-4a5b-939e-abbf5b73bf59 service nova] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0cfcf836-0f46-411e-aa57-2401cdc14c3f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  943.513643] env[65478]: DEBUG nova.compute.manager [req-0dfcef7c-bdbe-4fff-ab56-0a8164a1f31f req-b57c4800-86e4-4a5b-939e-abbf5b73bf59 service nova] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Detach interface failed, port_id=fc5c04e7-8dac-4f1f-a5e4-9f9d31498143, reason: Instance 9b286a00-af27-4012-a596-45bbe98da254 could not be found. {{(pid=65478) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}}
[  943.952416] env[65478]: INFO nova.compute.manager [-] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Took 1.47 seconds to deallocate network for instance.
[  944.460315] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  944.460595] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  944.462537] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  944.491735] env[65478]: INFO nova.scheduler.client.report [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Deleted allocations for instance 9b286a00-af27-4012-a596-45bbe98da254
[  945.001107] env[65478]: DEBUG oslo_concurrency.lockutils [None req-0ea9c2fa-6947-4c5f-9e64-aaac3626daec tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] Lock "9b286a00-af27-4012-a596-45bbe98da254" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.124s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  945.848572] env[65478]: WARNING nova.utils [None req-02ffff04-ccb1-478d-91e5-2cf9bf2501e4 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d920465ab0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[  957.404076] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  957.404415] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  957.911505] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  957.912278] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  957.912466] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  957.912944] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  957.912944] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  957.912944] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  957.913230] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[  957.913230] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[  958.416585] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  958.416585] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  958.416585] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  958.416585] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[  958.417600] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-69a9de52-f307-470b-b32d-3faceeb897b0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  958.425967] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ce07e25c-9232-4468-ba71-7ffbc2951360 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  958.439943] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-bb16ed16-a4c4-49ca-9a1b-4a297cbef7c0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  958.446509] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b20d2f05-97ca-4548-a2f8-09a2b531e3cf {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  958.477119] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=179829MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[  958.477260] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[  958.477437] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[  958.614594] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[  959.516947] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e4810749-aefd-411e-87c1-5b1b1967538f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  959.517216] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance db37d828-c474-4577-816b-6fb2fcd9a82b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  959.517216] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance c0545749-bc03-4f28-a0d4-ebaf55049095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  959.517303] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance f37353fc-a5c5-41db-9d2c-c1f286fe321b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  959.517418] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ef569806-5f50-44b9-a4a9-0107328a8dfe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 2, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  959.517510] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  959.517610] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  959.517705] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  959.517799] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  959.517894] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  959.518093] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  959.518209] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 6f6c4cda-9439-47dd-810c-25b0516585e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  959.518308] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  959.518403] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  959.518539] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  959.518583] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[  960.021814] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 5fc40115-fc0a-4401-9083-5bc33290e8c4 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  960.525237] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 932f3bea-bf9d-441a-bcdb-71f852c523a9 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  961.027907] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 566cb5a1-5b9f-485d-9a00-ad38858e0b8e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  961.531854] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 560ca9f0-3db2-496c-8024-03859950f4ee has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  962.033479] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance a5f42a18-2651-4205-92a9-f4f6d7311071 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  962.536635] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 38551259-1e20-4db6-baae-981d16134ff0 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  963.039573] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 6d37dc97-5130-4be4-a7c1-bf304611e810 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  963.542434] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 2bbba546-6e53-4822-bcc7-45ed3d530f40 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  964.045290] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 36018dbd-f4b1-4740-a7bb-e96e5c174be0 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  964.548115] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance c8ba7da3-c9c5-4dbc-ad17-ca9d977a9adb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  965.050871] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance a2b3619c-81d9-4788-b745-b541a0678c19 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  965.553801] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 1b7bac20-84c0-4b19-b759-b75e84c7abee has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  966.057062] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 26c4f07f-f4de-46b1-a462-b8cf13da075e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  966.560184] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 509b45f9-3415-4649-a019-dd2c8c5fd8ff has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  967.062847] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance c8729cf3-8200-49b1-9a43-6f05d129ec54 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  967.565862] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance cf71fee6-8723-4171-b56a-5d26a1cf9979 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  968.068678] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e0b34ad2-0d29-4935-9b48-3ef09a437d4d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  968.571636] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance bdaff834-f206-4ebc-aca7-29f922604daf has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  969.074859] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance f8ba0630-2e2b-4991-b828-f2ac8f79a32f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[  969.075165] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 16 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[  969.075324] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=3712MB phys_disk=100GB used_disk=17GB total_vcpus=48 used_vcpus=16 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '16', 'num_vm_active': '6', 'num_task_None': '6', 'num_os_type_None': '16', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '2', 'io_workload': '10', 'num_proj_a8a09b6e5ab3418e871f2d26fcd10a07': '3', 'num_proj_9f34d9b19c94478089fed931e391dfb7': '1', 'num_proj_70efc035843c47d69ec6a42f446a2b91': '1', 'num_vm_building': '10', 'num_task_spawning': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[  969.479553] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-750d9bf4-2384-49ae-b0bb-12c4873495ee {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  969.487076] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4c51410e-2bfd-42c8-be8b-3211203ae587 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  969.517898] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-dc9aed01-34ba-4cf1-a04a-eed8b1103080 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  969.525139] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-5a32e96d-8ee1-41f3-808d-8820ee9fc440 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[  969.537902] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[  970.040887] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[  970.545847] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[  970.546143] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 12.069s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[  970.546358] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1016.539806] env[65478]: DEBUG oslo_concurrency.lockutils [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Acquiring lock "ef569806-5f50-44b9-a4a9-0107328a8dfe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1016.540084] env[65478]: DEBUG oslo_concurrency.lockutils [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Lock "ef569806-5f50-44b9-a4a9-0107328a8dfe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1016.540231] env[65478]: DEBUG oslo_concurrency.lockutils [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Acquiring lock "ef569806-5f50-44b9-a4a9-0107328a8dfe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1016.540411] env[65478]: DEBUG oslo_concurrency.lockutils [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Lock "ef569806-5f50-44b9-a4a9-0107328a8dfe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1016.540507] env[65478]: DEBUG oslo_concurrency.lockutils [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Lock "ef569806-5f50-44b9-a4a9-0107328a8dfe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1016.543308] env[65478]: INFO nova.compute.manager [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Terminating instance
[ 1017.048812] env[65478]: DEBUG nova.compute.manager [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[ 1017.048985] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[ 1017.050075] env[65478]: DEBUG oslo_vmware.service [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6e8f6ef3-2a31-4a4b-9717-433e6b7965f7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1017.059592] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[ 1017.059856] env[65478]: DEBUG oslo_vmware.service [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-a9901387-527e-41f5-adaf-6cf5aa185e36 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1017.066224] env[65478]: DEBUG oslo_vmware.api [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Waiting for the task: (returnval){
[ 1017.066224] env[65478]:    value = "task-6011879"
[ 1017.066224] env[65478]:    _type = "Task"
[ 1017.066224] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1017.074616] env[65478]: DEBUG oslo_vmware.api [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011879, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1017.575738] env[65478]: DEBUG oslo_vmware.api [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011879, 'name': PowerOffVM_Task, 'duration_secs': 0.200353} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1017.576045] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[ 1017.576045] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[ 1017.576214] env[65478]: DEBUG oslo_vmware.service [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-69a3ee5a-2d6a-4903-82cc-b2799c02b6cf {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1017.630748] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[ 1017.630928] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Deleting contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[ 1017.631088] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Deleting the datastore file [datastore1] ef569806-5f50-44b9-a4a9-0107328a8dfe {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[ 1017.631390] env[65478]: DEBUG oslo_vmware.service [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-3f9a3c41-dd71-4e66-badf-7a113c9ca580 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1017.642591] env[65478]: DEBUG oslo_vmware.api [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Waiting for the task: (returnval){
[ 1017.642591] env[65478]:    value = "task-6011881"
[ 1017.642591] env[65478]:    _type = "Task"
[ 1017.642591] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1017.650425] env[65478]: DEBUG oslo_vmware.api [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011881, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1018.152687] env[65478]: DEBUG oslo_vmware.api [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Task: {'id': task-6011881, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.178407} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1018.152865] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[ 1018.153017] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Deleted contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[ 1018.153153] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[ 1018.153286] env[65478]: INFO nova.compute.manager [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Took 1.10 seconds to destroy the instance on the hypervisor.
[ 1018.154015] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[ 1018.154167] env[65478]: DEBUG nova.compute.manager [-] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[ 1018.154271] env[65478]: DEBUG nova.network.neutron [-] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[ 1018.154558] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[ 1018.210378] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[ 1018.731959] env[65478]: DEBUG nova.compute.manager [req-a004acd2-c0e4-48d0-8c48-7be4de1e65b0 req-07f7dffd-8e38-4127-9752-07ea1b0ea78f service nova] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Received event network-vif-deleted-d0ba0aff-4125-4028-bb87-c0e783d1e066 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[ 1018.732266] env[65478]: INFO nova.compute.manager [req-a004acd2-c0e4-48d0-8c48-7be4de1e65b0 req-07f7dffd-8e38-4127-9752-07ea1b0ea78f service nova] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Neutron deleted interface d0ba0aff-4125-4028-bb87-c0e783d1e066; detaching it from the instance and deleting it from the info cache
[ 1018.732266] env[65478]: DEBUG nova.network.neutron [req-a004acd2-c0e4-48d0-8c48-7be4de1e65b0 req-07f7dffd-8e38-4127-9752-07ea1b0ea78f service nova] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[ 1019.133280] env[65478]: DEBUG nova.network.neutron [-] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[ 1019.235486] env[65478]: DEBUG oslo_vmware.service [req-a004acd2-c0e4-48d0-8c48-7be4de1e65b0 req-07f7dffd-8e38-4127-9752-07ea1b0ea78f service nova] Invoking SearchIndex.FindAllByUuid with opID=oslo.vmware-d48943bd-7bb6-489b-a6fb-3e86340d6eb5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1019.245780] env[65478]: DEBUG oslo_vmware.service [req-a004acd2-c0e4-48d0-8c48-7be4de1e65b0 req-07f7dffd-8e38-4127-9752-07ea1b0ea78f service nova] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8480b374-6725-4626-a7d6-4ae99079e148 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1019.279173] env[65478]: DEBUG nova.compute.manager [req-a004acd2-c0e4-48d0-8c48-7be4de1e65b0 req-07f7dffd-8e38-4127-9752-07ea1b0ea78f service nova] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Detach interface failed, port_id=d0ba0aff-4125-4028-bb87-c0e783d1e066, reason: Instance ef569806-5f50-44b9-a4a9-0107328a8dfe could not be found. {{(pid=65478) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}}
[ 1019.635211] env[65478]: INFO nova.compute.manager [-] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Took 1.48 seconds to deallocate network for instance.
[ 1020.142080] env[65478]: DEBUG oslo_concurrency.lockutils [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1020.142080] env[65478]: DEBUG oslo_concurrency.lockutils [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1020.142461] env[65478]: DEBUG nova.objects.instance [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Lazy-loading 'resources' on Instance uuid ef569806-5f50-44b9-a4a9-0107328a8dfe {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[ 1021.059134] env[65478]: DEBUG oslo_vmware.service [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-de5adb8d-b2d1-4850-906b-567c62ad4204 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1021.070036] env[65478]: DEBUG oslo_vmware.service [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e26b9816-ec2e-47cd-b1d9-f4dc8bbf30ef {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1021.103181] env[65478]: DEBUG oslo_vmware.service [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-fee1a44c-b002-4b31-8608-2797217ff172 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1021.110431] env[65478]: DEBUG oslo_vmware.service [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ce95b76f-6f4f-48ce-b3b0-256c3c715abc {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1021.125398] env[65478]: DEBUG nova.compute.provider_tree [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 1021.566481] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9e9a79e6-6c4b-43fb-b5e0-1a87dd95d258 tempest-ServerExternalEventsTest-743771553 tempest-ServerExternalEventsTest-743771553-project-member] Acquiring lock "77a0e8c4-b77a-45b9-a249-d98866d4048a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1021.628373] env[65478]: DEBUG nova.scheduler.client.report [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 1022.133136] env[65478]: DEBUG oslo_concurrency.lockutils [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.991s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1022.152678] env[65478]: INFO nova.scheduler.client.report [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Deleted allocations for instance ef569806-5f50-44b9-a4a9-0107328a8dfe
[ 1022.662267] env[65478]: DEBUG oslo_concurrency.lockutils [None req-51d17a61-e658-4f0b-b5a1-a49b852696f5 tempest-ServersWithSpecificFlavorTestJSON-1793762876 tempest-ServersWithSpecificFlavorTestJSON-1793762876-project-member] Lock "ef569806-5f50-44b9-a4a9-0107328a8dfe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.122s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1023.925541] env[65478]: DEBUG oslo_concurrency.lockutils [None req-8ffcfdb3-aa57-4690-889c-b2ea2709d58c tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] Acquiring lock "30e11bc9-0bfa-4cbf-bd02-f8262e343b79" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1024.369194] env[65478]: DEBUG oslo_concurrency.lockutils [None req-393b71da-aac5-4a5a-a578-4a84e0a4507f tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Acquiring lock "d4d3cf75-1781-46ed-afb2-44e6f2c048e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1024.558798] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4a874c0b-e005-4223-a544-658e87361610 tempest-ServersListShow2100Test-1629338982 tempest-ServersListShow2100Test-1629338982-project-member] Acquiring lock "00b6d30d-5de3-4c87-8af4-0fe6d88eb906" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1027.367822] env[65478]: DEBUG oslo_concurrency.lockutils [None req-d92f78ac-ad4e-4078-9bd8-07d0070326d6 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Acquiring lock "25ec70f9-947b-4ebe-82df-1a1ddcc59360" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1028.971101] env[65478]: DEBUG oslo_concurrency.lockutils [None req-10d1da7d-69d4-4b5d-adce-f448d9aa850a tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] Acquiring lock "e2e07720-a241-4382-a684-0835b199e37d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1029.340639] env[65478]: DEBUG oslo_concurrency.lockutils [None req-ab5518fb-39c9-4e71-accc-37b6a7b0da82 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Acquiring lock "28d4751c-5d09-422a-84b1-e82df32f6b4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1030.547765] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1030.547765] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1030.547765] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1030.547765] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1030.547765] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1030.547765] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1030.547765] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1030.548250] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 1030.548250] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1031.056879] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1031.056879] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1031.056879] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1031.056879] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 1031.057900] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8f725d9d-897b-4cc8-a347-f16da81daf63 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1031.066024] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9ecba8ad-5b4b-442f-a172-128f68c813f7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1031.081135] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6a437c08-64bf-4d4e-b2ef-21a73f13ff94 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1031.088113] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-06825bc3-5d03-43b1-8883-d57e8c83019e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1031.120908] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=180858MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 1031.121066] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1031.121246] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1031.351979] env[65478]: WARNING nova.utils [None req-626f6a22-b1e9-43f1-9f5d-7808fbf67259 tempest-ImagesTestJSON-212743090 tempest-ImagesTestJSON-212743090-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d92033ab90> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1032.157923] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e4810749-aefd-411e-87c1-5b1b1967538f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1032.158180] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance db37d828-c474-4577-816b-6fb2fcd9a82b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1032.158180] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance c0545749-bc03-4f28-a0d4-ebaf55049095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1032.158276] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance f37353fc-a5c5-41db-9d2c-c1f286fe321b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1032.158375] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1032.158478] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1032.159211] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1032.159376] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1032.159483] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1032.159582] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1032.159688] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 6f6c4cda-9439-47dd-810c-25b0516585e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1032.159785] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1032.159879] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1032.159971] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1032.160075] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1032.665410] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 932f3bea-bf9d-441a-bcdb-71f852c523a9 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1033.169971] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 566cb5a1-5b9f-485d-9a00-ad38858e0b8e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1033.673024] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 560ca9f0-3db2-496c-8024-03859950f4ee has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1034.176372] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance a5f42a18-2651-4205-92a9-f4f6d7311071 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1034.374766] env[65478]: INFO nova.compute.manager [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Rebuilding instance
[ 1034.423680] env[65478]: DEBUG nova.compute.manager [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[ 1034.424814] env[65478]: DEBUG oslo_vmware.service [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-962bdfe9-24a4-4dd1-91a8-09de73f52345 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1034.679682] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 38551259-1e20-4db6-baae-981d16134ff0 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1035.182880] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 6d37dc97-5130-4be4-a7c1-bf304611e810 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1035.440382] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[ 1035.440808] env[65478]: DEBUG oslo_vmware.service [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-28a43369-674d-4901-a224-d398823c8827 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1035.448524] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[ 1035.448524] env[65478]:    value = "task-6011882"
[ 1035.448524] env[65478]:    _type = "Task"
[ 1035.448524] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1035.456996] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011882, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1035.685839] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 2bbba546-6e53-4822-bcc7-45ed3d530f40 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1035.958442] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011882, 'name': PowerOffVM_Task, 'duration_secs': 0.1833} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1035.958640] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[ 1035.959866] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[ 1035.960799] env[65478]: DEBUG oslo_vmware.service [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-bc79b5ad-7837-419e-9c6c-567470ea0392 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1035.968303] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[ 1035.968681] env[65478]: DEBUG oslo_vmware.service [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-fd55606e-d59d-44bb-b39e-18b7a56fffeb {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1036.028130] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[ 1036.028414] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Deleting contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[ 1036.028584] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Deleting the datastore file [datastore1] db37d828-c474-4577-816b-6fb2fcd9a82b {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[ 1036.028851] env[65478]: DEBUG oslo_vmware.service [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-057163a8-29fd-419b-9ec5-608072d9cb1c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1036.035353] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[ 1036.035353] env[65478]:    value = "task-6011884"
[ 1036.035353] env[65478]:    _type = "Task"
[ 1036.035353] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1036.043784] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011884, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1036.189161] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 36018dbd-f4b1-4740-a7bb-e96e5c174be0 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1036.547278] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011884, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.141075} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1036.547510] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[ 1036.547674] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Deleted contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[ 1036.547837] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[ 1036.692966] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance c8ba7da3-c9c5-4dbc-ad17-ca9d977a9adb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1037.197212] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance a2b3619c-81d9-4788-b745-b541a0678c19 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1037.587350] env[65478]: DEBUG nova.virt.hardware [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[ 1037.587556] env[65478]: DEBUG nova.virt.hardware [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[ 1037.587651] env[65478]: DEBUG nova.virt.hardware [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[ 1037.587784] env[65478]: DEBUG nova.virt.hardware [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[ 1037.587885] env[65478]: DEBUG nova.virt.hardware [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[ 1037.587989] env[65478]: DEBUG nova.virt.hardware [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[ 1037.588490] env[65478]: DEBUG nova.virt.hardware [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[ 1037.588490] env[65478]: DEBUG nova.virt.hardware [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[ 1037.588616] env[65478]: DEBUG nova.virt.hardware [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[ 1037.588766] env[65478]: DEBUG nova.virt.hardware [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[ 1037.588957] env[65478]: DEBUG nova.virt.hardware [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[ 1037.589975] env[65478]: DEBUG oslo_vmware.service [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c2251291-fd59-41cd-9e3f-b89cafb5fbfa {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1037.598961] env[65478]: DEBUG oslo_vmware.service [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4be00caa-6104-484a-a255-9c22f3d051c5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1037.613381] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:16:7e:3c', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': '3c92f34c-1dd7-4dc5-b8e8-f6c55cc5b4b8', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': '321b5f6a-6eb5-4a41-86a9-3eac3f4def7b', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[ 1037.621905] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[ 1037.622173] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[ 1037.622480] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-0bcaa9a7-539b-42a4-b318-89820156b15a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1037.644553] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[ 1037.644553] env[65478]:    value = "task-6011885"
[ 1037.644553] env[65478]:    _type = "Task"
[ 1037.644553] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1037.653410] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011885, 'name': CreateVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1037.701504] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 1b7bac20-84c0-4b19-b759-b75e84c7abee has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1038.156328] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011885, 'name': CreateVM_Task, 'duration_secs': 0.322681} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1038.156752] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[ 1038.159019] env[65478]: WARNING neutronclient.v2_0.client [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
[ 1038.159019] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[ 1038.159019] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[ 1038.159019] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquired external semaphore "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[ 1038.159019] env[65478]: DEBUG oslo_vmware.service [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-a1e2ec59-2fc9-486a-a4b0-07d4be9263fb {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1038.163691] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[ 1038.163691] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]5284d8d4-65a2-7eb1-f860-5b0169f73934"
[ 1038.163691] env[65478]:    _type = "Task"
[ 1038.163691] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1038.172663] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5284d8d4-65a2-7eb1-f860-5b0169f73934, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1038.204998] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 26c4f07f-f4de-46b1-a462-b8cf13da075e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1038.683855] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5284d8d4-65a2-7eb1-f860-5b0169f73934, 'name': SearchDatastore_Task, 'duration_secs': 0.010066} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1038.684144] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[ 1038.684345] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[ 1038.684540] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[ 1038.684645] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[ 1038.684797] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Creating directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[ 1038.685103] env[65478]: DEBUG oslo_vmware.service [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-d98546f9-c6c1-4ceb-b9cc-7706a66faa23 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1038.692738] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Created directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[ 1038.693458] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Folder [datastore1] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[ 1038.693754] env[65478]: DEBUG oslo_vmware.service [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-d4932339-2778-496b-b806-be9886cc4317 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1038.699571] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[ 1038.699571] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]5260b062-616a-fc92-3e80-c2178a5f7a2b"
[ 1038.699571] env[65478]:    _type = "Task"
[ 1038.699571] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1038.707969] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5260b062-616a-fc92-3e80-c2178a5f7a2b, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1038.709900] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 509b45f9-3415-4649-a019-dd2c8c5fd8ff has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1039.209655] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5260b062-616a-fc92-3e80-c2178a5f7a2b, 'name': SearchDatastore_Task, 'duration_secs': 0.008008} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1039.210415] env[65478]: DEBUG oslo_vmware.service [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-c1f45265-8ca8-4e0a-b679-e87552b5663e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1039.214401] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance c8729cf3-8200-49b1-9a43-6f05d129ec54 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1039.217368] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[ 1039.217368] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52349e25-ec79-41a8-ba44-f0ef40e9fcc8"
[ 1039.217368] env[65478]:    _type = "Task"
[ 1039.217368] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1039.226468] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52349e25-ec79-41a8-ba44-f0ef40e9fcc8, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1039.717809] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance cf71fee6-8723-4171-b56a-5d26a1cf9979 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1039.731077] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52349e25-ec79-41a8-ba44-f0ef40e9fcc8, 'name': SearchDatastore_Task, 'duration_secs': 0.008949} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1039.731077] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[ 1039.731209] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Copying Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] db37d828-c474-4577-816b-6fb2fcd9a82b/db37d828-c474-4577-816b-6fb2fcd9a82b.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[ 1039.731458] env[65478]: DEBUG oslo_vmware.service [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-aaab872d-b201-4c9a-95e2-237073ead90d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1039.738117] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[ 1039.738117] env[65478]:    value = "task-6011886"
[ 1039.738117] env[65478]:    _type = "Task"
[ 1039.738117] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1039.746437] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011886, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1039.864495] env[65478]: WARNING nova.utils [None req-c49a1f09-1f00-41d6-81ff-480a7c2762a7 tempest-ServerDiskConfigTestJSON-1007286184 tempest-ServerDiskConfigTestJSON-1007286184-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d9386eb2e0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1040.225621] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e0b34ad2-0d29-4935-9b48-3ef09a437d4d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1040.250563] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011886, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.453012} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1040.251185] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Copied Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] db37d828-c474-4577-816b-6fb2fcd9a82b/db37d828-c474-4577-816b-6fb2fcd9a82b.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[ 1040.251404] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[ 1040.251636] env[65478]: DEBUG oslo_vmware.service [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-3a575f05-9720-4dac-9474-cb9970bca384 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1040.257761] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[ 1040.257761] env[65478]:    value = "task-6011887"
[ 1040.257761] env[65478]:    _type = "Task"
[ 1040.257761] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1040.265871] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011887, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1040.728508] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance bdaff834-f206-4ebc-aca7-29f922604daf has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1040.766535] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011887, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.056632} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1040.766735] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[ 1040.767527] env[65478]: DEBUG oslo_vmware.service [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-640358a8-6e55-45fa-b95c-432fa4068b1f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1040.790213] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Reconfiguring VM instance instance-00000015 to attach disk [datastore1] db37d828-c474-4577-816b-6fb2fcd9a82b/db37d828-c474-4577-816b-6fb2fcd9a82b.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[ 1040.790499] env[65478]: DEBUG oslo_vmware.service [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-8aa0b0ec-747b-4ade-9d64-be3db70cbd91 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1040.810413] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[ 1040.810413] env[65478]:    value = "task-6011888"
[ 1040.810413] env[65478]:    _type = "Task"
[ 1040.810413] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1040.818145] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011888, 'name': ReconfigVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1041.231383] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance f8ba0630-2e2b-4991-b828-f2ac8f79a32f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1041.319811] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011888, 'name': ReconfigVM_Task, 'duration_secs': 0.264546} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1041.320042] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Reconfigured VM instance instance-00000015 to attach disk [datastore1] db37d828-c474-4577-816b-6fb2fcd9a82b/db37d828-c474-4577-816b-6fb2fcd9a82b.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[ 1041.320626] env[65478]: DEBUG oslo_vmware.service [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-e3ef6b65-9ca9-457f-8d5b-972ebe22a43d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1041.326379] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[ 1041.326379] env[65478]:    value = "task-6011889"
[ 1041.326379] env[65478]:    _type = "Task"
[ 1041.326379] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1041.336397] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011889, 'name': Rename_Task} progress is 5%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1041.734039] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 870f1c7c-2fe6-4d5b-ba1a-5063abcf97fd has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1041.734181] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 15 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 1041.734324] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=3520MB phys_disk=100GB used_disk=15GB total_vcpus=48 used_vcpus=15 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '15', 'num_vm_active': '5', 'num_task_None': '5', 'num_os_type_None': '15', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '2', 'io_workload': '10', 'num_proj_a8a09b6e5ab3418e871f2d26fcd10a07': '3', 'num_proj_9f34d9b19c94478089fed931e391dfb7': '1', 'num_vm_building': '10', 'num_task_deleting': '7', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_task_spawning': '3', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 1041.839316] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011889, 'name': Rename_Task, 'duration_secs': 0.148161} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1041.839536] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[ 1041.839791] env[65478]: DEBUG oslo_vmware.service [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-80314d99-67ba-490d-ae08-5a5866157115 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1041.846150] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[ 1041.846150] env[65478]:    value = "task-6011890"
[ 1041.846150] env[65478]:    _type = "Task"
[ 1041.846150] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1041.854934] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011890, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1042.188796] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b2c2d848-c9e6-459d-8a26-2433ed1e6e34 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1042.196450] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-083d95d1-18b6-4e0b-bdf1-33e6b2f69f08 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1042.229263] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4af8678f-0138-4e8d-afe2-68cef2d37467 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1042.238675] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-bc919ccf-a117-4a3b-acd7-2221662ba39b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1042.253257] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 1042.356272] env[65478]: DEBUG oslo_vmware.api [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011890, 'name': PowerOnVM_Task, 'duration_secs': 0.449622} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1042.356643] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[ 1042.356922] env[65478]: DEBUG nova.compute.manager [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[ 1042.357757] env[65478]: DEBUG oslo_vmware.service [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9cc55ae1-6670-4e87-8d8d-df2927f22d92 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1042.756598] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 1042.875101] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1043.262774] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 1043.263131] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 12.142s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1043.263170] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 42.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1043.263699] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.389s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1043.264275] env[65478]: DEBUG nova.objects.instance [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Trying to apply a migration context that does not seem to be set for this instance {{(pid=65478) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
[ 1044.274922] env[65478]: DEBUG oslo_concurrency.lockutils [None req-4b7ffa63-0748-42a2-838a-3a3b4be28597 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.011s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1046.439661] env[65478]: INFO nova.compute.manager [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Rebuilding instance
[ 1046.487467] env[65478]: DEBUG nova.compute.manager [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[ 1046.488409] env[65478]: DEBUG oslo_vmware.service [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-965c63e3-8100-48a7-82e7-5b386874d289 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1047.502028] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[ 1047.502028] env[65478]: DEBUG oslo_vmware.service [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-017dd1e7-e4e7-4249-927d-3c780e32c763 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1047.510675] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[ 1047.510675] env[65478]:    value = "task-6011891"
[ 1047.510675] env[65478]:    _type = "Task"
[ 1047.510675] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1047.522737] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011891, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1047.727777] env[65478]: WARNING nova.utils [None req-7df4cace-0b58-4328-b28f-18d0581bb896 tempest-ServersNegativeTestJSON-1142513340 tempest-ServersNegativeTestJSON-1142513340-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d9386eadd0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1048.020115] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011891, 'name': PowerOffVM_Task, 'duration_secs': 0.170978} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1048.020323] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[ 1048.020511] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[ 1048.021371] env[65478]: DEBUG oslo_vmware.service [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-fb1e46ea-80d6-430f-89ad-81a17dd59c47 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1048.027899] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[ 1048.028158] env[65478]: DEBUG oslo_vmware.service [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-c98a4095-c4aa-4b45-95df-0c1eebf604aa {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1048.082814] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[ 1048.082976] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Deleting contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[ 1048.083131] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Deleting the datastore file [datastore1] db37d828-c474-4577-816b-6fb2fcd9a82b {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[ 1048.083384] env[65478]: DEBUG oslo_vmware.service [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-7eaf6ee0-2ccc-4f93-b554-8cb2387c9f95 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1048.090100] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[ 1048.090100] env[65478]:    value = "task-6011893"
[ 1048.090100] env[65478]:    _type = "Task"
[ 1048.090100] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1048.097413] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011893, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1048.331570] env[65478]: WARNING nova.utils [None req-bdff281c-4a23-454f-bbaa-930b1727e52d tempest-SecurityGroupsTestJSON-1593388229 tempest-SecurityGroupsTestJSON-1593388229-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d9386eab90> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1048.600079] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011893, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.137041} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1048.600389] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[ 1048.600422] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Deleted contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[ 1048.600556] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[ 1049.634720] env[65478]: DEBUG nova.virt.hardware [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-02-03T14:34:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879b8eacf4b511d84bac79c7fe0e0d0a',container_format='bare',created_at=2026-02-03T14:33:50Z,direct_url=<?>,disk_format='vmdk',id=901a05bf-ca6f-4e54-a6ec-7c357eec1043,min_disk=0,min_ram=0,name='cirros-d240228-sparse;paraVirtual;vmxnet3',owner='eb20b7ec77e847179c9940510a8b48bf',properties=ImageMetaProps,protected=<?>,size=21318656,status='active',tags=<?>,updated_at=2026-02-03T14:33:51Z,virtual_size=<?>,visibility=<?>), allow threads: False {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}}
[ 1049.635043] env[65478]: DEBUG nova.virt.hardware [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Flavor limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}}
[ 1049.635043] env[65478]: DEBUG nova.virt.hardware [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Image limits 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}}
[ 1049.635309] env[65478]: DEBUG nova.virt.hardware [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Flavor pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}}
[ 1049.635309] env[65478]: DEBUG nova.virt.hardware [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Image pref 0:0:0 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}}
[ 1049.635418] env[65478]: DEBUG nova.virt.hardware [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}}
[ 1049.635587] env[65478]: DEBUG nova.virt.hardware [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
[ 1049.636156] env[65478]: DEBUG nova.virt.hardware [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}}
[ 1049.636156] env[65478]: DEBUG nova.virt.hardware [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Got 1 possible topologies {{(pid=65478) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}}
[ 1049.636156] env[65478]: DEBUG nova.virt.hardware [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}}
[ 1049.636156] env[65478]: DEBUG nova.virt.hardware [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=65478) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}}
[ 1049.636967] env[65478]: DEBUG oslo_vmware.service [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-535b3207-06ef-410e-9b1f-091ff20a95c1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1049.645619] env[65478]: DEBUG oslo_vmware.service [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3066490a-73b8-46f7-a1e6-e3b6f379bdd1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1049.660637] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Instance VIF info [{'network_name': 'br-int', 'mac_address': 'fa:16:3e:16:7e:3c', 'network_ref': {'type': 'OpaqueNetwork', 'network-id': '3c92f34c-1dd7-4dc5-b8e8-f6c55cc5b4b8', 'network-type': 'nsx.LogicalSwitch', 'use-external-id': True}, 'iface_id': '321b5f6a-6eb5-4a41-86a9-3eac3f4def7b', 'vif_model': 'vmxnet3'}] {{(pid=65478) build_virtual_machine /opt/stack/nova/nova/virt/vmwareapi/vmops.py:279}}
[ 1049.668947] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for function nova.virt.vmwareapi.vm_util.create_vm to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[ 1049.669669] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Creating VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1337}}
[ 1049.669979] env[65478]: DEBUG oslo_vmware.service [-] Invoking Folder.CreateVM_Task with opID=oslo.vmware-3adb036c-77c0-4d04-a9ef-7da9249beebc {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1049.690581] env[65478]: DEBUG oslo_vmware.api [-] Waiting for the task: (returnval){
[ 1049.690581] env[65478]:    value = "task-6011894"
[ 1049.690581] env[65478]:    _type = "Task"
[ 1049.690581] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1049.699090] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011894, 'name': CreateVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1050.199840] env[65478]: DEBUG oslo_vmware.api [-] Task: {'id': task-6011894, 'name': CreateVM_Task, 'duration_secs': 0.277368} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1050.200192] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [-] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Created VM on the ESX host {{(pid=65478) create_vm /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1359}}
[ 1050.200956] env[65478]: WARNING neutronclient.v2_0.client [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
[ 1050.201475] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[ 1050.201647] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[ 1050.201957] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquired external semaphore "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[ 1050.202397] env[65478]: DEBUG oslo_vmware.service [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-57670596-9640-43ec-9fa8-32d518d17818 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1050.207272] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[ 1050.207272] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]527bbe8b-b230-6679-92bf-b506bfafd3dc"
[ 1050.207272] env[65478]:    _type = "Task"
[ 1050.207272] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1050.215115] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]527bbe8b-b230-6679-92bf-b506bfafd3dc, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1050.718412] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]527bbe8b-b230-6679-92bf-b506bfafd3dc, 'name': SearchDatastore_Task, 'duration_secs': 0.008297} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1050.718675] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[ 1050.718841] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Processing image 901a05bf-ca6f-4e54-a6ec-7c357eec1043 {{(pid=65478) _fetch_image_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:624}}
[ 1050.719043] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[ 1050.719168] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[ 1050.719271] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Creating directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:399}}
[ 1050.719512] env[65478]: DEBUG oslo_vmware.service [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking FileManager.MakeDirectory with opID=oslo.vmware-b9165fc9-cf97-42fe-a088-43379fe08afd {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1050.726750] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Created directory with path [datastore1] devstack-image-cache_base {{(pid=65478) mkdir /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:404}}
[ 1050.726875] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Folder [datastore1] devstack-image-cache_base created. {{(pid=65478) _create_folder_if_missing /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1845}}
[ 1050.727647] env[65478]: DEBUG oslo_vmware.service [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-d2e0f7fd-994d-4a48-8a9a-5663635b58b6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1050.733115] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[ 1050.733115] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]526c7d95-bd0c-34e5-de18-01546ea1049b"
[ 1050.733115] env[65478]:    _type = "Task"
[ 1050.733115] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1050.741785] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]526c7d95-bd0c-34e5-de18-01546ea1049b, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1051.242480] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]526c7d95-bd0c-34e5-de18-01546ea1049b, 'name': SearchDatastore_Task, 'duration_secs': 0.007926} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1051.243287] env[65478]: DEBUG oslo_vmware.service [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-d25c487d-e00f-4525-80f9-c42a7ba94147 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1051.248435] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[ 1051.248435] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52803529-eeba-0e91-8808-66f1e70541b8"
[ 1051.248435] env[65478]:    _type = "Task"
[ 1051.248435] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1051.255610] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52803529-eeba-0e91-8808-66f1e70541b8, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1051.757629] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52803529-eeba-0e91-8808-66f1e70541b8, 'name': SearchDatastore_Task, 'duration_secs': 0.008679} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1051.757920] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[ 1051.758031] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Copying Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] db37d828-c474-4577-816b-6fb2fcd9a82b/db37d828-c474-4577-816b-6fb2fcd9a82b.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1423}}
[ 1051.758278] env[65478]: DEBUG oslo_vmware.service [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualDiskManager.CopyVirtualDisk_Task with opID=oslo.vmware-77a9b61c-2771-41eb-9db2-cd3d492eeb36 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1051.764707] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[ 1051.764707] env[65478]:    value = "task-6011895"
[ 1051.764707] env[65478]:    _type = "Task"
[ 1051.764707] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1051.772222] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011895, 'name': CopyVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1052.274361] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011895, 'name': CopyVirtualDisk_Task, 'duration_secs': 0.441603} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1052.274682] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Copied Virtual Disk [datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043/901a05bf-ca6f-4e54-a6ec-7c357eec1043.vmdk to [datastore1] db37d828-c474-4577-816b-6fb2fcd9a82b/db37d828-c474-4577-816b-6fb2fcd9a82b.vmdk {{(pid=65478) copy_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1434}}
[ 1052.274917] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Extending root virtual disk to 1048576 {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:167}}
[ 1052.275202] env[65478]: DEBUG oslo_vmware.service [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualDiskManager.ExtendVirtualDisk_Task with opID=oslo.vmware-a63a1def-0168-4bbf-a31e-6585e04c9cca {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1052.280953] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[ 1052.280953] env[65478]:    value = "task-6011896"
[ 1052.280953] env[65478]:    _type = "Task"
[ 1052.280953] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1052.287866] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011896, 'name': ExtendVirtualDisk_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1052.790519] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011896, 'name': ExtendVirtualDisk_Task, 'duration_secs': 0.056878} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1052.790816] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Extended root virtual disk {{(pid=65478) _extend_virtual_disk /opt/stack/nova/nova/virt/vmwareapi/vmops.py:189}}
[ 1052.791449] env[65478]: DEBUG oslo_vmware.service [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-641bbf6f-f0dd-426e-ace7-45ddb724472b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1052.813450] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Reconfiguring VM instance instance-00000015 to attach disk [datastore1] db37d828-c474-4577-816b-6fb2fcd9a82b/db37d828-c474-4577-816b-6fb2fcd9a82b.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:81}}
[ 1052.813709] env[65478]: DEBUG oslo_vmware.service [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualMachine.ReconfigVM_Task with opID=oslo.vmware-c2840fe2-5299-41fa-9a54-ec2119c76f7a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1052.833471] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[ 1052.833471] env[65478]:    value = "task-6011897"
[ 1052.833471] env[65478]:    _type = "Task"
[ 1052.833471] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1052.841168] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011897, 'name': ReconfigVM_Task} progress is 6%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1053.342893] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011897, 'name': ReconfigVM_Task, 'duration_secs': 0.264593} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1053.343122] env[65478]: DEBUG nova.virt.vmwareapi.volumeops [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Reconfigured VM instance instance-00000015 to attach disk [datastore1] db37d828-c474-4577-816b-6fb2fcd9a82b/db37d828-c474-4577-816b-6fb2fcd9a82b.vmdk or device None with type sparse {{(pid=65478) attach_disk_to_vm /opt/stack/nova/nova/virt/vmwareapi/volumeops.py:88}}
[ 1053.343742] env[65478]: DEBUG oslo_vmware.service [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualMachine.Rename_Task with opID=oslo.vmware-b228cde1-dd76-4a51-8cbb-4b72be97781e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1053.348810] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[ 1053.348810] env[65478]:    value = "task-6011898"
[ 1053.348810] env[65478]:    _type = "Task"
[ 1053.348810] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1053.356078] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011898, 'name': Rename_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1053.857685] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011898, 'name': Rename_Task, 'duration_secs': 0.12287} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1053.857931] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Powering on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1452}}
[ 1053.858152] env[65478]: DEBUG oslo_vmware.service [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualMachine.PowerOnVM_Task with opID=oslo.vmware-7e94a548-11fb-4815-a82e-576b24025e2f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1053.863944] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[ 1053.863944] env[65478]:    value = "task-6011899"
[ 1053.863944] env[65478]:    _type = "Task"
[ 1053.863944] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1053.871286] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011899, 'name': PowerOnVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1054.372555] env[65478]: DEBUG oslo_vmware.api [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011899, 'name': PowerOnVM_Task, 'duration_secs': 0.422406} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1054.372747] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Powered on the VM {{(pid=65478) power_on_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1458}}
[ 1054.372902] env[65478]: DEBUG nova.compute.manager [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Checking state {{(pid=65478) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}}
[ 1054.373674] env[65478]: DEBUG oslo_vmware.service [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-42017436-5e09-443f-a3bf-f63d830380fe {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1054.889552] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1054.889888] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1054.889888] env[65478]: DEBUG nova.objects.instance [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Trying to apply a migration context that does not seem to be set for this instance {{(pid=65478) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
[ 1055.898911] env[65478]: DEBUG oslo_concurrency.lockutils [None req-1cb58fcd-d1cf-4a3e-8efc-65c8fbd81706 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.008s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1056.317035] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "f37353fc-a5c5-41db-9d2c-c1f286fe321b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1056.317171] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "f37353fc-a5c5-41db-9d2c-c1f286fe321b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1056.317303] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "f37353fc-a5c5-41db-9d2c-c1f286fe321b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1056.317441] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "f37353fc-a5c5-41db-9d2c-c1f286fe321b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1056.317566] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "f37353fc-a5c5-41db-9d2c-c1f286fe321b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1056.319681] env[65478]: INFO nova.compute.manager [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Terminating instance
[ 1056.822791] env[65478]: DEBUG nova.compute.manager [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[ 1056.823121] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[ 1056.824305] env[65478]: DEBUG oslo_vmware.service [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-54444409-d48c-4d55-bdd3-6f3e7898d846 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1056.832187] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[ 1056.832487] env[65478]: DEBUG oslo_vmware.service [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-568a8aa7-7f32-43df-8eb4-3c28d63d901c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1056.839229] env[65478]: DEBUG oslo_vmware.api [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[ 1056.839229] env[65478]:    value = "task-6011900"
[ 1056.839229] env[65478]:    _type = "Task"
[ 1056.839229] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1056.848795] env[65478]: DEBUG oslo_vmware.api [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011900, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1057.349044] env[65478]: DEBUG oslo_vmware.api [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011900, 'name': PowerOffVM_Task, 'duration_secs': 0.181296} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1057.349044] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[ 1057.349044] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[ 1057.349595] env[65478]: DEBUG oslo_vmware.service [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-e452838e-7db8-4300-a4fa-29e961c2beb6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1057.584707] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[ 1057.584871] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Deleting contents of the VM from datastore datastore2 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[ 1057.585017] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Deleting the datastore file [datastore2] f37353fc-a5c5-41db-9d2c-c1f286fe321b {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[ 1057.585284] env[65478]: DEBUG oslo_vmware.service [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-971b66f3-ce7f-4428-886f-9f861b6c99f5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1057.591219] env[65478]: DEBUG oslo_vmware.api [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[ 1057.591219] env[65478]:    value = "task-6011902"
[ 1057.591219] env[65478]:    _type = "Task"
[ 1057.591219] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1057.599288] env[65478]: DEBUG oslo_vmware.api [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011902, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1058.101028] env[65478]: DEBUG oslo_vmware.api [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011902, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.142868} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1058.101208] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[ 1058.101344] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Deleted contents of the VM from datastore datastore2 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[ 1058.101475] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[ 1058.101603] env[65478]: INFO nova.compute.manager [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Took 1.28 seconds to destroy the instance on the hypervisor.
[ 1058.102148] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[ 1058.102409] env[65478]: DEBUG nova.compute.manager [-] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[ 1058.102514] env[65478]: DEBUG nova.network.neutron [-] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[ 1058.102759] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[ 1058.134476] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[ 1058.393673] env[65478]: DEBUG nova.compute.manager [req-778d8955-a4cb-481d-b3e8-76cbb6ba09c3 req-ff6601ba-f601-4a70-8f41-cd73968e2ec8 service nova] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Received event network-vif-deleted-7b4081eb-c84e-4089-9d64-3d42f3c25b01 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[ 1058.393927] env[65478]: INFO nova.compute.manager [req-778d8955-a4cb-481d-b3e8-76cbb6ba09c3 req-ff6601ba-f601-4a70-8f41-cd73968e2ec8 service nova] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Neutron deleted interface 7b4081eb-c84e-4089-9d64-3d42f3c25b01; detaching it from the instance and deleting it from the info cache
[ 1058.394014] env[65478]: DEBUG nova.network.neutron [req-778d8955-a4cb-481d-b3e8-76cbb6ba09c3 req-ff6601ba-f601-4a70-8f41-cd73968e2ec8 service nova] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[ 1058.847809] env[65478]: DEBUG nova.network.neutron [-] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[ 1058.896338] env[65478]: DEBUG oslo_vmware.service [req-778d8955-a4cb-481d-b3e8-76cbb6ba09c3 req-ff6601ba-f601-4a70-8f41-cd73968e2ec8 service nova] Invoking SearchIndex.FindAllByUuid with opID=oslo.vmware-4973a46c-3085-4437-9b42-73a5d94c7027 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1058.906532] env[65478]: DEBUG oslo_vmware.service [req-778d8955-a4cb-481d-b3e8-76cbb6ba09c3 req-ff6601ba-f601-4a70-8f41-cd73968e2ec8 service nova] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8421a3bd-30e7-40e9-b907-a6a1f43209bf {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1058.936975] env[65478]: DEBUG nova.compute.manager [req-778d8955-a4cb-481d-b3e8-76cbb6ba09c3 req-ff6601ba-f601-4a70-8f41-cd73968e2ec8 service nova] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Detach interface failed, port_id=7b4081eb-c84e-4089-9d64-3d42f3c25b01, reason: Instance f37353fc-a5c5-41db-9d2c-c1f286fe321b could not be found. {{(pid=65478) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}}
[ 1059.349940] env[65478]: INFO nova.compute.manager [-] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Took 1.25 seconds to deallocate network for instance.
[ 1059.858584] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1059.858874] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1059.859016] env[65478]: DEBUG nova.objects.instance [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lazy-loading 'resources' on Instance uuid f37353fc-a5c5-41db-9d2c-c1f286fe321b {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[ 1060.764085] env[65478]: DEBUG oslo_vmware.service [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4b0a83b8-f2b6-46a1-8fee-96fba92fb42e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1060.772881] env[65478]: DEBUG oslo_vmware.service [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-dc27465d-4c4b-4bc0-9773-302aab9c6274 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1060.803840] env[65478]: DEBUG oslo_vmware.service [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ae34db2a-6f8b-48c3-a91b-7c22333c7c8a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1060.811832] env[65478]: DEBUG oslo_vmware.service [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-fea5b601-f509-46cc-815c-d5562ce4b637 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1060.825669] env[65478]: DEBUG nova.compute.provider_tree [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 1061.328858] env[65478]: DEBUG nova.scheduler.client.report [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 1061.833659] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.975s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1061.852653] env[65478]: INFO nova.scheduler.client.report [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Deleted allocations for instance f37353fc-a5c5-41db-9d2c-c1f286fe321b
[ 1062.364157] env[65478]: DEBUG oslo_concurrency.lockutils [None req-9d1f4ea8-10e3-4d2e-9574-70eacda6a65c tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "f37353fc-a5c5-41db-9d2c-c1f286fe321b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.045s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1063.716567] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "c0545749-bc03-4f28-a0d4-ebaf55049095" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1063.717095] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "c0545749-bc03-4f28-a0d4-ebaf55049095" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1063.717359] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "c0545749-bc03-4f28-a0d4-ebaf55049095-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1063.717522] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "c0545749-bc03-4f28-a0d4-ebaf55049095-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1063.717654] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "c0545749-bc03-4f28-a0d4-ebaf55049095-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1063.719966] env[65478]: INFO nova.compute.manager [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Terminating instance
[ 1064.223677] env[65478]: DEBUG nova.compute.manager [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[ 1064.223858] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[ 1064.224889] env[65478]: DEBUG oslo_vmware.service [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9942519d-e107-478a-89e3-2fed05627b57 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1064.234098] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[ 1064.234370] env[65478]: DEBUG oslo_vmware.service [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-10302e2b-7766-4ae1-84c3-2e3cdf79d410 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1064.242638] env[65478]: DEBUG oslo_vmware.api [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[ 1064.242638] env[65478]:    value = "task-6011903"
[ 1064.242638] env[65478]:    _type = "Task"
[ 1064.242638] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1064.253262] env[65478]: DEBUG oslo_vmware.api [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011903, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1064.579432] env[65478]: WARNING nova.utils [None req-e8065992-4407-4105-bd87-5a1665123eaf tempest-ServersListShow298Test-791794275 tempest-ServersListShow298Test-791794275-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d920339e10> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1064.753853] env[65478]: DEBUG oslo_vmware.api [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011903, 'name': PowerOffVM_Task, 'duration_secs': 0.268003} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1064.754633] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[ 1064.755696] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[ 1064.755696] env[65478]: DEBUG oslo_vmware.service [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-415864b9-4f79-4bbc-ac3b-0196a4ae7ec4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1064.811671] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[ 1064.811842] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Deleting contents of the VM from datastore datastore2 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[ 1064.812037] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Deleting the datastore file [datastore2] c0545749-bc03-4f28-a0d4-ebaf55049095 {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[ 1064.812254] env[65478]: DEBUG oslo_vmware.service [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-bd766551-907a-4398-bdfe-6188b50342d2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1064.818512] env[65478]: DEBUG oslo_vmware.api [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[ 1064.818512] env[65478]:    value = "task-6011905"
[ 1064.818512] env[65478]:    _type = "Task"
[ 1064.818512] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1064.829307] env[65478]: DEBUG oslo_vmware.api [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011905, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1065.330814] env[65478]: DEBUG oslo_vmware.api [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011905, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.143032} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1065.331101] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[ 1065.331446] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Deleted contents of the VM from datastore datastore2 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[ 1065.331637] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[ 1065.331783] env[65478]: INFO nova.compute.manager [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Took 1.11 seconds to destroy the instance on the hypervisor.
[ 1065.332387] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[ 1065.332634] env[65478]: DEBUG nova.compute.manager [-] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[ 1065.332764] env[65478]: DEBUG nova.network.neutron [-] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[ 1065.333036] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[ 1065.510420] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[ 1065.835821] env[65478]: DEBUG nova.compute.manager [req-b2bbce2c-f582-46b4-a276-a8ef9446796c req-2de6a211-77ed-4ac9-b34d-60125fec9fe1 service nova] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Received event network-vif-deleted-9ccf1586-6b31-4e80-9174-a6868c4d116a {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[ 1065.836655] env[65478]: INFO nova.compute.manager [req-b2bbce2c-f582-46b4-a276-a8ef9446796c req-2de6a211-77ed-4ac9-b34d-60125fec9fe1 service nova] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Neutron deleted interface 9ccf1586-6b31-4e80-9174-a6868c4d116a; detaching it from the instance and deleting it from the info cache
[ 1065.836799] env[65478]: DEBUG nova.network.neutron [req-b2bbce2c-f582-46b4-a276-a8ef9446796c req-2de6a211-77ed-4ac9-b34d-60125fec9fe1 service nova] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[ 1066.296657] env[65478]: DEBUG nova.network.neutron [-] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[ 1066.339455] env[65478]: DEBUG oslo_vmware.service [req-b2bbce2c-f582-46b4-a276-a8ef9446796c req-2de6a211-77ed-4ac9-b34d-60125fec9fe1 service nova] Invoking SearchIndex.FindAllByUuid with opID=oslo.vmware-a54f57d8-7379-4017-90b9-9bc84412e53d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1066.348043] env[65478]: DEBUG oslo_vmware.service [req-b2bbce2c-f582-46b4-a276-a8ef9446796c req-2de6a211-77ed-4ac9-b34d-60125fec9fe1 service nova] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4d991081-702d-40e0-ab43-08b47c78793c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1066.376298] env[65478]: DEBUG nova.compute.manager [req-b2bbce2c-f582-46b4-a276-a8ef9446796c req-2de6a211-77ed-4ac9-b34d-60125fec9fe1 service nova] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Detach interface failed, port_id=9ccf1586-6b31-4e80-9174-a6868c4d116a, reason: Instance c0545749-bc03-4f28-a0d4-ebaf55049095 could not be found. {{(pid=65478) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}}
[ 1066.799690] env[65478]: INFO nova.compute.manager [-] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Took 1.47 seconds to deallocate network for instance.
[ 1067.309091] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1067.309427] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1067.309427] env[65478]: DEBUG nova.objects.instance [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lazy-loading 'resources' on Instance uuid c0545749-bc03-4f28-a0d4-ebaf55049095 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[ 1068.197599] env[65478]: DEBUG oslo_vmware.service [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-10dff06f-fd67-4165-9105-701f8b9fc12c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1068.204962] env[65478]: DEBUG oslo_vmware.service [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c19587f6-f8a2-41f6-bf76-a9c90cd2cdfb {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1068.238982] env[65478]: DEBUG oslo_vmware.service [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-7e5bcd1e-5ad1-4cd3-862c-a5d55a6753c0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1068.247693] env[65478]: DEBUG oslo_vmware.service [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9f8de0a4-ec71-4c72-b61e-af02c0463a09 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1068.262255] env[65478]: DEBUG nova.compute.provider_tree [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 1068.768403] env[65478]: DEBUG nova.scheduler.client.report [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 1069.273386] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.964s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1069.302447] env[65478]: INFO nova.scheduler.client.report [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Deleted allocations for instance c0545749-bc03-4f28-a0d4-ebaf55049095
[ 1069.810969] env[65478]: DEBUG oslo_concurrency.lockutils [None req-a2bb28a3-f8a1-407d-b341-469d70503353 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "c0545749-bc03-4f28-a0d4-ebaf55049095" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.094s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1070.482565] env[65478]: DEBUG oslo_concurrency.lockutils [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "db37d828-c474-4577-816b-6fb2fcd9a82b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1070.482724] env[65478]: DEBUG oslo_concurrency.lockutils [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "db37d828-c474-4577-816b-6fb2fcd9a82b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1070.482925] env[65478]: DEBUG oslo_concurrency.lockutils [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "db37d828-c474-4577-816b-6fb2fcd9a82b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1070.483066] env[65478]: DEBUG oslo_concurrency.lockutils [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "db37d828-c474-4577-816b-6fb2fcd9a82b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1070.484759] env[65478]: DEBUG oslo_concurrency.lockutils [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "db37d828-c474-4577-816b-6fb2fcd9a82b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1070.485353] env[65478]: INFO nova.compute.manager [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Terminating instance
[ 1070.992134] env[65478]: DEBUG nova.compute.manager [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[ 1070.992134] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[ 1070.992134] env[65478]: DEBUG oslo_vmware.service [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-acbbdbda-f6aa-4b82-9df5-f657ef3fc4ef {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1071.000126] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[ 1071.000392] env[65478]: DEBUG oslo_vmware.service [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-c508085a-dcb6-4b47-bf1f-c2025dc2fe93 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1071.014292] env[65478]: DEBUG oslo_vmware.api [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[ 1071.014292] env[65478]:    value = "task-6011906"
[ 1071.014292] env[65478]:    _type = "Task"
[ 1071.014292] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1071.018706] env[65478]: DEBUG oslo_vmware.api [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011906, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1071.521762] env[65478]: DEBUG oslo_vmware.api [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011906, 'name': PowerOffVM_Task, 'duration_secs': 0.180919} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1071.522038] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[ 1071.522544] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[ 1071.522544] env[65478]: DEBUG oslo_vmware.service [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-670cbbce-81a8-4ad7-925e-74dc81a0523b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1071.578054] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[ 1071.578237] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Deleting contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[ 1071.578388] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Deleting the datastore file [datastore1] db37d828-c474-4577-816b-6fb2fcd9a82b {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[ 1071.578660] env[65478]: DEBUG oslo_vmware.service [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-477640f5-f4ce-44b2-b378-40a38d0a4aef {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1071.591024] env[65478]: DEBUG oslo_vmware.api [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for the task: (returnval){
[ 1071.591024] env[65478]:    value = "task-6011908"
[ 1071.591024] env[65478]:    _type = "Task"
[ 1071.591024] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1071.596657] env[65478]: DEBUG oslo_vmware.api [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011908, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1071.860072] env[65478]: WARNING nova.utils [None req-4ef22566-feb7-4ed6-95fe-17a80a1a8439 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8fc6c5b40> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1072.098175] env[65478]: DEBUG oslo_vmware.api [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Task: {'id': task-6011908, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.152355} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1072.098486] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[ 1072.098544] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Deleted contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[ 1072.098636] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[ 1072.098822] env[65478]: INFO nova.compute.manager [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Took 1.11 seconds to destroy the instance on the hypervisor.
[ 1072.099358] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[ 1072.099358] env[65478]: DEBUG nova.compute.manager [-] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[ 1072.099358] env[65478]: DEBUG nova.network.neutron [-] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[ 1072.099358] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[ 1072.142334] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[ 1072.447854] env[65478]: DEBUG nova.compute.manager [req-0c4cef05-fc21-4f7e-b355-a5524b66d75a req-b7d04288-9f28-4d79-82ef-a06888508f0a service nova] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Received event network-vif-deleted-321b5f6a-6eb5-4a41-86a9-3eac3f4def7b {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[ 1072.448036] env[65478]: INFO nova.compute.manager [req-0c4cef05-fc21-4f7e-b355-a5524b66d75a req-b7d04288-9f28-4d79-82ef-a06888508f0a service nova] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Neutron deleted interface 321b5f6a-6eb5-4a41-86a9-3eac3f4def7b; detaching it from the instance and deleting it from the info cache
[ 1072.448172] env[65478]: DEBUG nova.network.neutron [req-0c4cef05-fc21-4f7e-b355-a5524b66d75a req-b7d04288-9f28-4d79-82ef-a06888508f0a service nova] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[ 1072.892936] env[65478]: DEBUG nova.network.neutron [-] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[ 1072.951540] env[65478]: DEBUG oslo_vmware.service [req-0c4cef05-fc21-4f7e-b355-a5524b66d75a req-b7d04288-9f28-4d79-82ef-a06888508f0a service nova] Invoking SearchIndex.FindAllByUuid with opID=oslo.vmware-377052f2-5253-4bea-9a7c-22992ac09002 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1072.960753] env[65478]: DEBUG oslo_vmware.service [req-0c4cef05-fc21-4f7e-b355-a5524b66d75a req-b7d04288-9f28-4d79-82ef-a06888508f0a service nova] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-493799aa-a410-46c1-a663-0694cd785513 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1072.981109] env[65478]: WARNING nova.utils [None req-699fbee3-d39f-481c-8383-e980c207bec2 tempest-ServerTagsTestJSON-264236760 tempest-ServerTagsTestJSON-264236760-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8dc741900> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1072.993590] env[65478]: DEBUG nova.compute.manager [req-0c4cef05-fc21-4f7e-b355-a5524b66d75a req-b7d04288-9f28-4d79-82ef-a06888508f0a service nova] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Detach interface failed, port_id=321b5f6a-6eb5-4a41-86a9-3eac3f4def7b, reason: Instance db37d828-c474-4577-816b-6fb2fcd9a82b could not be found. {{(pid=65478) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}}
[ 1073.395755] env[65478]: INFO nova.compute.manager [-] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Took 1.30 seconds to deallocate network for instance.
[ 1073.902522] env[65478]: DEBUG oslo_concurrency.lockutils [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1073.902736] env[65478]: DEBUG oslo_concurrency.lockutils [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1073.902913] env[65478]: DEBUG nova.objects.instance [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lazy-loading 'resources' on Instance uuid db37d828-c474-4577-816b-6fb2fcd9a82b {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[ 1074.741721] env[65478]: DEBUG oslo_vmware.service [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8c016fe8-a302-4ecc-9cd9-2a14800f3252 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1074.749212] env[65478]: DEBUG oslo_vmware.service [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1d8c4455-bd46-4a80-98c7-741c370784ac {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1074.779685] env[65478]: DEBUG oslo_vmware.service [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e4cd3245-4e00-41a6-ad35-3751e44685e1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1074.787541] env[65478]: DEBUG oslo_vmware.service [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3e320060-a910-46f9-aa54-9821c6e98fd1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1074.802196] env[65478]: DEBUG nova.compute.provider_tree [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 1075.305373] env[65478]: DEBUG nova.scheduler.client.report [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 1075.811816] env[65478]: DEBUG oslo_concurrency.lockutils [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.909s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1075.831139] env[65478]: INFO nova.scheduler.client.report [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Deleted allocations for instance db37d828-c474-4577-816b-6fb2fcd9a82b
[ 1076.338185] env[65478]: DEBUG oslo_concurrency.lockutils [None req-eb99c49a-e1fc-44d0-bfa1-f17363fcf3e3 tempest-ServersAdminTestJSON-126550973 tempest-ServersAdminTestJSON-126550973-project-member] Lock "db37d828-c474-4577-816b-6fb2fcd9a82b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.855s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1078.618085] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1081.944581] env[65478]: WARNING nova.utils [None req-0fd5bb02-558c-4266-b7b5-2db9a21aa4ce tempest-ServersAdminNegativeTestJSON-727543838 tempest-ServersAdminNegativeTestJSON-727543838-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8dc740280> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1085.261193] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1085.261587] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1085.768018] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1085.768203] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1085.768317] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1085.768429] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1085.769048] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1085.769048] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1085.769048] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 1085.769048] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1086.271462] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1086.271847] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1086.271974] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1086.272136] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 1086.273098] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-03463986-d517-4ad5-b9f7-bc8d472a1a18 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1086.281140] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3f9f53d0-c60f-4344-8b81-206e997853d3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1086.297226] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-64ee4cd4-1070-4516-80ab-19e53c7d3c90 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1086.304599] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-61ae6db3-31f2-4dec-9269-2fdbe04c849d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1086.335126] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=181333MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 1086.335303] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1086.335487] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1087.366068] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e4810749-aefd-411e-87c1-5b1b1967538f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1087.366327] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1087.366405] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1087.366546] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1087.366682] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1087.366839] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1087.366982] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1087.367130] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 6f6c4cda-9439-47dd-810c-25b0516585e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1087.367262] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1087.367391] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1087.367520] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1087.367647] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1087.870870] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 509b45f9-3415-4649-a019-dd2c8c5fd8ff has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1088.373934] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance c8729cf3-8200-49b1-9a43-6f05d129ec54 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1088.877535] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance cf71fee6-8723-4171-b56a-5d26a1cf9979 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1089.380556] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e0b34ad2-0d29-4935-9b48-3ef09a437d4d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1089.883579] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance bdaff834-f206-4ebc-aca7-29f922604daf has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1090.386724] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance f8ba0630-2e2b-4991-b828-f2ac8f79a32f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1090.889617] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 870f1c7c-2fe6-4d5b-ba1a-5063abcf97fd has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1091.392522] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e5eb155d-56ea-46b3-b26d-73e9cbc810d2 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1091.895717] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 3f4db4a8-cdd5-4f2b-8fcb-586c684f29d1 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1092.398621] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8beaed8a-3766-49fc-a8b5-e2c6809a6a82 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1092.901568] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 5b3b546a-e7b2-4a0c-a37b-7fadcf5f34d9 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1093.404879] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 71e1862c-8483-4db4-a0f7-191384c2bdf8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1093.908051] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 50411d7d-2523-46a0-89eb-1fef7d96e312 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1094.410966] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 4d84d8ba-6daf-45ff-949a-e0725fa1c92c has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1094.411275] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 12 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 1094.411403] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2944MB phys_disk=100GB used_disk=12GB total_vcpus=48 used_vcpus=12 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '12', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '12', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '2', 'io_workload': '10', 'num_proj_9f34d9b19c94478089fed931e391dfb7': '1', 'num_vm_building': '10', 'num_task_deleting': '7', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_task_spawning': '3', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 1094.763121] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4feccad7-c943-4500-be4a-12535c7242ad {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1094.770574] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6cd38869-d418-46b0-a8e9-ca1644119cba {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1094.804412] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-fcdaa83f-f2de-4912-b34b-f82286907265 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1094.814122] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-be96e936-f263-476b-bca8-ba44c7704679 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1094.828301] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 1095.242611] env[65478]: DEBUG oslo_concurrency.lockutils [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Acquiring lock "6f6c4cda-9439-47dd-810c-25b0516585e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1095.242822] env[65478]: DEBUG oslo_concurrency.lockutils [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Lock "6f6c4cda-9439-47dd-810c-25b0516585e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1095.243040] env[65478]: DEBUG oslo_concurrency.lockutils [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Acquiring lock "6f6c4cda-9439-47dd-810c-25b0516585e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1095.243183] env[65478]: DEBUG oslo_concurrency.lockutils [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Lock "6f6c4cda-9439-47dd-810c-25b0516585e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1095.243321] env[65478]: DEBUG oslo_concurrency.lockutils [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Lock "6f6c4cda-9439-47dd-810c-25b0516585e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1095.245792] env[65478]: INFO nova.compute.manager [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Terminating instance
[ 1095.332416] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 1095.749821] env[65478]: DEBUG nova.compute.manager [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[ 1095.750189] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[ 1095.750980] env[65478]: DEBUG oslo_vmware.service [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9ffaa1dc-68fb-4516-bd4d-df9dbb1b1b59 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1095.758762] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[ 1095.759009] env[65478]: DEBUG oslo_vmware.service [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-1d484463-d2d0-46a5-abaa-0be88484654b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1095.770289] env[65478]: DEBUG oslo_vmware.api [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Waiting for the task: (returnval){
[ 1095.770289] env[65478]:    value = "task-6011909"
[ 1095.770289] env[65478]:    _type = "Task"
[ 1095.770289] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1095.781103] env[65478]: DEBUG oslo_vmware.api [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011909, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1095.837078] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 1095.837235] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 9.502s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1095.837446] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1096.281245] env[65478]: DEBUG oslo_vmware.api [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011909, 'name': PowerOffVM_Task, 'duration_secs': 0.257386} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1096.281245] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[ 1096.281245] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[ 1096.281245] env[65478]: DEBUG oslo_vmware.service [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-81f05c71-8e14-4c81-acb4-4f6ea80aa79e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1096.342121] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[ 1096.342330] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Deleting contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[ 1096.342474] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Deleting the datastore file [datastore1] 6f6c4cda-9439-47dd-810c-25b0516585e6 {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[ 1096.342743] env[65478]: DEBUG oslo_vmware.service [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-315bf467-614d-4e8c-a003-dc34456338b1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1096.349078] env[65478]: DEBUG oslo_vmware.api [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Waiting for the task: (returnval){
[ 1096.349078] env[65478]:    value = "task-6011911"
[ 1096.349078] env[65478]:    _type = "Task"
[ 1096.349078] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1096.356788] env[65478]: DEBUG oslo_vmware.api [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011911, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1096.815652] env[65478]: WARNING nova.utils [None req-fe0eae0e-b2a8-4473-8ebf-36905c50031d tempest-ServersAaction247Test-728848764 tempest-ServersAaction247Test-728848764-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8dc75b910> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1096.858765] env[65478]: DEBUG oslo_vmware.api [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Task: {'id': task-6011911, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.300168} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1096.859277] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[ 1096.859434] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Deleted contents of the VM from datastore datastore1 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[ 1096.859644] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[ 1096.859792] env[65478]: INFO nova.compute.manager [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Took 1.11 seconds to destroy the instance on the hypervisor.
[ 1096.860535] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[ 1096.860782] env[65478]: DEBUG nova.compute.manager [-] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[ 1096.860885] env[65478]: DEBUG nova.network.neutron [-] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[ 1096.861178] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[ 1096.934911] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[ 1097.199847] env[65478]: DEBUG nova.compute.manager [req-6ee43f81-b295-4346-8c0c-128b2aba4a1a req-9fe88952-d35d-4d8c-9724-f2b6ab8838bd service nova] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Received event network-vif-deleted-0c0d9e92-abc5-4d72-881a-e5bca5e8ff47 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[ 1097.200123] env[65478]: INFO nova.compute.manager [req-6ee43f81-b295-4346-8c0c-128b2aba4a1a req-9fe88952-d35d-4d8c-9724-f2b6ab8838bd service nova] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Neutron deleted interface 0c0d9e92-abc5-4d72-881a-e5bca5e8ff47; detaching it from the instance and deleting it from the info cache
[ 1097.200294] env[65478]: DEBUG nova.network.neutron [req-6ee43f81-b295-4346-8c0c-128b2aba4a1a req-9fe88952-d35d-4d8c-9724-f2b6ab8838bd service nova] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[ 1097.629012] env[65478]: DEBUG nova.network.neutron [-] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[ 1097.703096] env[65478]: DEBUG oslo_vmware.service [req-6ee43f81-b295-4346-8c0c-128b2aba4a1a req-9fe88952-d35d-4d8c-9724-f2b6ab8838bd service nova] Invoking SearchIndex.FindAllByUuid with opID=oslo.vmware-6293a0cf-1823-46b8-bfb6-89d9fecfe10b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1097.713630] env[65478]: DEBUG oslo_vmware.service [req-6ee43f81-b295-4346-8c0c-128b2aba4a1a req-9fe88952-d35d-4d8c-9724-f2b6ab8838bd service nova] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-11501169-341c-42a5-aac1-1bc1743f0713 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1097.742046] env[65478]: DEBUG nova.compute.manager [req-6ee43f81-b295-4346-8c0c-128b2aba4a1a req-9fe88952-d35d-4d8c-9724-f2b6ab8838bd service nova] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Detach interface failed, port_id=0c0d9e92-abc5-4d72-881a-e5bca5e8ff47, reason: Instance 6f6c4cda-9439-47dd-810c-25b0516585e6 could not be found. {{(pid=65478) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}}
[ 1098.131040] env[65478]: INFO nova.compute.manager [-] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Took 1.27 seconds to deallocate network for instance.
[ 1098.639554] env[65478]: DEBUG oslo_concurrency.lockutils [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1098.639743] env[65478]: DEBUG oslo_concurrency.lockutils [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1098.639928] env[65478]: DEBUG nova.objects.instance [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Lazy-loading 'resources' on Instance uuid 6f6c4cda-9439-47dd-810c-25b0516585e6 {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[ 1099.468296] env[65478]: DEBUG oslo_vmware.service [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-943fa29f-5b31-4c6f-9475-0425d57df1a2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1099.476294] env[65478]: DEBUG oslo_vmware.service [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-19d935d5-6019-419b-8995-0422cd6e1a02 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1099.511130] env[65478]: DEBUG oslo_vmware.service [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-66a7828d-9043-49f3-a899-f152cd71864f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1099.519861] env[65478]: DEBUG oslo_vmware.service [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-42e6dbd6-fd8a-4cbe-ada1-c0c87f335618 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1099.535029] env[65478]: DEBUG nova.compute.provider_tree [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 1100.037534] env[65478]: DEBUG nova.scheduler.client.report [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 1100.542501] env[65478]: DEBUG oslo_concurrency.lockutils [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.903s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1100.568665] env[65478]: INFO nova.scheduler.client.report [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Deleted allocations for instance 6f6c4cda-9439-47dd-810c-25b0516585e6
[ 1101.076541] env[65478]: DEBUG oslo_concurrency.lockutils [None req-efe58e6d-7f7c-498b-bc8b-edd858736ad9 tempest-MigrationsAdminTest-1137761975 tempest-MigrationsAdminTest-1137761975-project-member] Lock "6f6c4cda-9439-47dd-810c-25b0516585e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.834s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1110.881079] env[65478]: WARNING nova.utils [None req-caa54097-8ebc-43a0-9d0a-dd1ae49b3963 tempest-ServersNegativeTestMultiTenantJSON-1055846533 tempest-ServersNegativeTestMultiTenantJSON-1055846533-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d93a96d480> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1115.171046] env[65478]: WARNING nova.utils [None req-4817cdb2-6d08-46f3-88ca-960adaea8bd9 tempest-ServersTestMultiNic-907351750 tempest-ServersTestMultiNic-907351750-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8fc469fc0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1142.434261] env[65478]: WARNING nova.utils [None req-2e646d25-9d21-4243-8d95-c37853957129 tempest-ServerActionsTestOtherB-1445636573 tempest-ServerActionsTestOtherB-1445636573-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8dc75b7f0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1155.838063] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1155.838361] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1155.838451] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1155.838557] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1155.838662] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1155.838761] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1155.838861] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1155.838982] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 1155.839100] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1156.341890] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1156.342135] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1156.342345] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1156.342427] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 1156.343402] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-451692df-7489-4c80-a3f9-e7a8aa15a275 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1156.351512] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a8a6f914-69bc-4866-a85b-186b4d39e212 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1156.366347] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a30bbf32-b6eb-4aea-9f67-431b4878cc7b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1156.372850] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-2dea23ba-ff22-46d7-8cc0-b25ca5e26e3e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1156.403617] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=181781MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 1156.403819] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1156.403994] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1157.437529] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e4810749-aefd-411e-87c1-5b1b1967538f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1157.437853] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1157.437853] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1157.437969] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1157.438084] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1157.438226] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1157.438299] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1157.438384] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1157.438463] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1157.438584] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1157.438646] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1157.941551] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 870f1c7c-2fe6-4d5b-ba1a-5063abcf97fd has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1158.444407] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e5eb155d-56ea-46b3-b26d-73e9cbc810d2 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1158.946854] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 3f4db4a8-cdd5-4f2b-8fcb-586c684f29d1 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1159.449888] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8beaed8a-3766-49fc-a8b5-e2c6809a6a82 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1159.952947] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 5b3b546a-e7b2-4a0c-a37b-7fadcf5f34d9 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1160.455738] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 71e1862c-8483-4db4-a0f7-191384c2bdf8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1160.959077] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 50411d7d-2523-46a0-89eb-1fef7d96e312 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1161.461992] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 4d84d8ba-6daf-45ff-949a-e0725fa1c92c has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1161.964925] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 5009e0a7-fdda-4ec6-8551-7d80a556e3c6 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1162.467850] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance b8ddef20-3d33-4d71-ba41-1e5f88dc72d7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1162.970631] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance bc0d4d25-3dd7-4ae6-bcf9-b66a8fc68e88 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1163.473613] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 9be6233a-13aa-4978-93fd-04327697a4ab has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1163.474057] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 11 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 1163.474057] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2688MB phys_disk=100GB used_disk=11GB total_vcpus=48 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '11', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '11', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '2', 'io_workload': '10', 'num_vm_building': '10', 'num_task_deleting': '7', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_task_spawning': '3', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 1163.491069] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Refreshing inventories for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
[ 1163.505310] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Updating ProviderTree inventory for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
[ 1163.505477] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[ 1163.517317] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Refreshing aggregate associations for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5, aggregates: None {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
[ 1163.537918] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Refreshing trait associations for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_VMDK,COMPUTE_IMAGE_TYPE_ISO,HW_ARCH_X86_64,COMPUTE_SAME_HOST_COLD_MIGRATE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
[ 1163.832466] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8bcc4814-a140-4481-ab4d-a3696c080373 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1163.840883] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e43b490e-e491-45ec-8028-c579a38dbaef {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1163.874448] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3af8fd31-5f59-4bf1-8d2e-0304e5ba1f0e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1163.882809] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-2c22131d-cc43-4b07-a979-58dbf6cccd7a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1163.898028] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 1164.401131] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 1164.906065] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 1164.906483] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 8.502s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1164.906483] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 17.64 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1182.550043] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1183.051651] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 7.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1190.051518] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1190.051955] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1190.051955] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1190.554824] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1190.555048] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1190.555201] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1190.555339] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 1190.556292] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e87e1916-9f80-4250-a7d6-ec09209ee909 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1190.564655] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ff8c5a0e-b478-4294-9186-829e077dcbc8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1190.578760] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-867b1ad5-ed4c-4f9b-ab3e-ae613476913c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1190.585588] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c4a34018-311a-408f-a412-2b360f849a8a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1190.615996] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=181781MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 1190.616173] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1190.616359] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1191.716880] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e4810749-aefd-411e-87c1-5b1b1967538f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1191.717157] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1191.717245] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1191.717342] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1191.717475] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1191.717635] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1191.717762] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1191.717888] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1191.718015] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1191.718140] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1191.718258] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1192.220936] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 870f1c7c-2fe6-4d5b-ba1a-5063abcf97fd has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1192.723710] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e5eb155d-56ea-46b3-b26d-73e9cbc810d2 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1193.226804] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 3f4db4a8-cdd5-4f2b-8fcb-586c684f29d1 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1193.729750] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8beaed8a-3766-49fc-a8b5-e2c6809a6a82 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1194.232585] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 5b3b546a-e7b2-4a0c-a37b-7fadcf5f34d9 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1194.735576] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 71e1862c-8483-4db4-a0f7-191384c2bdf8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1195.238266] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 50411d7d-2523-46a0-89eb-1fef7d96e312 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1195.740829] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 4d84d8ba-6daf-45ff-949a-e0725fa1c92c has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1196.243946] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 5009e0a7-fdda-4ec6-8551-7d80a556e3c6 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1196.747057] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance b8ddef20-3d33-4d71-ba41-1e5f88dc72d7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1197.250274] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance bc0d4d25-3dd7-4ae6-bcf9-b66a8fc68e88 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1197.755931] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 9be6233a-13aa-4978-93fd-04327697a4ab has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1197.755931] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 11 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 1197.755931] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2688MB phys_disk=100GB used_disk=11GB total_vcpus=48 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '11', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '11', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '2', 'io_workload': '10', 'num_vm_building': '10', 'num_task_deleting': '7', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_task_spawning': '3', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 1198.000552] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-17e8758a-4493-4f4d-9b88-6a66eeadeca9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1198.007798] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f245b50e-18d4-4e6c-bc30-a503d920ae34 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1198.037998] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9ef882b9-68ca-4a8c-9e96-143ee65aac24 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1198.045121] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ab8385b9-7b90-43e9-a2ae-646a7de09d36 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1198.058580] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 1198.561747] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 1198.563298] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 1198.563506] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 7.947s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1198.563694] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1198.563837] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Cleaning up deleted instances {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11960}}
[ 1198.620614] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1199.069353] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] There are 11 instances to clean {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11969}}
[ 1199.069661] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: ef569806-5f50-44b9-a4a9-0107328a8dfe] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[ 1199.572774] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: e9f84a20-8def-4f36-92eb-8625364f7024] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[ 1200.076026] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: f37353fc-a5c5-41db-9d2c-c1f286fe321b] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[ 1200.579430] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: fbf21f21-d370-4a6a-ae24-0e6840464e24] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[ 1201.082624] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: 6f6c4cda-9439-47dd-810c-25b0516585e6] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[ 1201.585675] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: f0e88cef-300d-42a4-9cb6-843dc85da6a3] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[ 1202.090063] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: 9b286a00-af27-4012-a596-45bbe98da254] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[ 1202.592361] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: c0545749-bc03-4f28-a0d4-ebaf55049095] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[ 1203.095666] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: db37d828-c474-4577-816b-6fb2fcd9a82b] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[ 1203.598569] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: d978e71d-2c30-4a76-b000-6ddf3203ab10] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[ 1204.102026] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: 78246782-d2a2-4819-8924-51764ffe05aa] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[ 1204.604835] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1204.604990] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Cleaning up deleted instances with incomplete migration  {{(pid=65478) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11998}}
[ 1205.107511] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.49 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1206.600331] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1206.600612] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1207.107014] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1207.107178] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1207.107290] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1207.107409] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1207.107533] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 1207.107699] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 35.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1221.472101] env[65478]: WARNING nova.utils [None req-9c034187-c5c6-47db-9382-192374b1d282 tempest-ImagesOneServerNegativeTestJSON-1415533328 tempest-ImagesOneServerNegativeTestJSON-1415533328-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8dc742a70> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1222.171828] env[65478]: WARNING nova.utils [None req-864070da-d876-428b-b42c-b962b1487902 tempest-MultipleCreateTestJSON-1602728264 tempest-MultipleCreateTestJSON-1602728264-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8dc75ae60> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1222.201312] env[65478]: WARNING nova.utils [None req-864070da-d876-428b-b42c-b962b1487902 tempest-MultipleCreateTestJSON-1602728264 tempest-MultipleCreateTestJSON-1602728264-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d9386ea560> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1222.469251] env[65478]: WARNING nova.utils [None req-ee32fa50-ee78-4eb2-a45f-44b3bb8ed4fa tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8dc75be20> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1223.117983] env[65478]: DEBUG oslo_concurrency.lockutils [None req-66942609-a5cb-4d23-ad23-ae1ef385c251 tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Acquiring lock "ec1a8c79-d97b-4eb0-b024-1b0c86ccab17" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1225.199581] env[65478]: DEBUG oslo_concurrency.lockutils [None req-485cbbe0-f7f0-4f32-8c8b-4d1367148a03 tempest-ListImageFiltersTestJSON-824219760 tempest-ListImageFiltersTestJSON-824219760-project-member] Acquiring lock "8d032b6f-86df-4397-8727-d4336f973368" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1226.890157] env[65478]: WARNING nova.utils [None req-8ebfea02-d78e-4db1-b114-af28c65178b1 tempest-AttachVolumeTestJSON-722180738 tempest-AttachVolumeTestJSON-722180738-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8dc7585e0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1228.425926] env[65478]: WARNING nova.utils [None req-9ed2d6e2-8139-42b8-a314-b99db0e92e16 tempest-ImagesTestJSON-212743090 tempest-ImagesTestJSON-212743090-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8dc758dc0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1235.767733] env[65478]: WARNING nova.utils [None req-7ac521dc-5292-4f08-9cc2-92ee62263e40 tempest-ServerDiskConfigTestJSON-1007286184 tempest-ServerDiskConfigTestJSON-1007286184-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8dc743490> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1242.109265] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._sync_power_states {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1242.614167] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Getting list of instances from cluster (obj){
[ 1242.614167] env[65478]:    value = "domain-c8"
[ 1242.614167] env[65478]:    _type = "ClusterComputeResource"
[ 1242.614167] env[65478]:  } {{(pid=65478) list_instances /opt/stack/nova/nova/virt/vmwareapi/vmops.py:2116}}
[ 1242.615770] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-7d7ed98f-c38f-4a04-b8cb-4eac5ad683e8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1242.627544] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Got total of 1 instances {{(pid=65478) list_instances /opt/stack/nova/nova/virt/vmwareapi/vmops.py:2125}}
[ 1242.627688] env[65478]: WARNING nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] While synchronizing instance power states, found 11 instances in the database and 1 instances on the hypervisor.
[ 1242.627821] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Triggering sync for uuid e4810749-aefd-411e-87c1-5b1b1967538f {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11071}}
[ 1242.628326] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Triggering sync for uuid 77a0e8c4-b77a-45b9-a249-d98866d4048a {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11071}}
[ 1242.628779] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "e4810749-aefd-411e-87c1-5b1b1967538f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1242.629025] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "e4810749-aefd-411e-87c1-5b1b1967538f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1242.630211] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Triggering sync for uuid 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11071}}
[ 1242.630564] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-631dd433-828c-44b2-819d-933378c19236 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1242.633708] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "77a0e8c4-b77a-45b9-a249-d98866d4048a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1242.634165] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Triggering sync for uuid d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11071}}
[ 1242.634609] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "30e11bc9-0bfa-4cbf-bd02-f8262e343b79" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1242.634996] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Triggering sync for uuid 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11071}}
[ 1242.635450] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1242.639877] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Triggering sync for uuid d4d3cf75-1781-46ed-afb2-44e6f2c048e2 {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11071}}
[ 1242.644342] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "00b6d30d-5de3-4c87-8af4-0fe6d88eb906" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1242.644526] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Triggering sync for uuid ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11071}}
[ 1242.644677] env[65478]: WARNING nova.utils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x73d8fc469090> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1242.644845] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Triggering sync for uuid 25ec70f9-947b-4ebe-82df-1a1ddcc59360 {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11071}}
[ 1242.644960] env[65478]: WARNING nova.utils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x73d8fc469090> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1242.645132] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Triggering sync for uuid 8d032b6f-86df-4397-8727-d4336f973368 {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11071}}
[ 1242.645251] env[65478]: WARNING nova.utils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x73d8fc469090> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1242.645432] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Triggering sync for uuid e2e07720-a241-4382-a684-0835b199e37d {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11071}}
[ 1242.645549] env[65478]: WARNING nova.utils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x73d8fc469090> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1242.645695] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Triggering sync for uuid 28d4751c-5d09-422a-84b1-e82df32f6b4d {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11071}}
[ 1242.645979] env[65478]: WARNING nova.utils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x73d8fc469090> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1242.646044] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.90 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1243.141459] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "e4810749-aefd-411e-87c1-5b1b1967538f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.512s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1243.141829] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "d4d3cf75-1781-46ed-afb2-44e6f2c048e2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1249.549289] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1249.549619] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1250.052634] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1250.052863] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1250.052994] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1250.053156] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 1250.054097] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f60a1c0c-5f55-440f-b43b-1822a5636a3a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1250.062333] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8501f1b4-7013-48e8-823e-61d1d5c47ab9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1250.078536] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-62fb0724-5454-44f7-aef0-2266143d13f6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1250.085885] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f906e33f-06f5-465d-9f97-3c03c967ee4c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1250.117069] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=181799MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 1250.117212] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1250.117396] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1251.151282] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e4810749-aefd-411e-87c1-5b1b1967538f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1251.151616] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1251.151616] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1251.151616] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1251.151711] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1251.151814] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1251.151910] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1251.152016] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1251.152124] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1251.152219] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1251.152317] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1251.655563] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 5b3b546a-e7b2-4a0c-a37b-7fadcf5f34d9 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1252.158536] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 71e1862c-8483-4db4-a0f7-191384c2bdf8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1252.661374] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 50411d7d-2523-46a0-89eb-1fef7d96e312 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1253.164225] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 4d84d8ba-6daf-45ff-949a-e0725fa1c92c has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1253.667253] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 5009e0a7-fdda-4ec6-8551-7d80a556e3c6 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1254.171043] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance b8ddef20-3d33-4d71-ba41-1e5f88dc72d7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1254.673909] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance bc0d4d25-3dd7-4ae6-bcf9-b66a8fc68e88 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1255.177713] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 9be6233a-13aa-4978-93fd-04327697a4ab has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1255.680948] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d74865e8-e131-4dfa-a8ed-7886d7f33ef1 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1256.183830] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance fd88eace-477d-4b06-99d1-1068aabac135 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1256.686845] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 2c7e9f7a-4212-44da-a54f-9c3de95af6b0 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1257.190228] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance b87b3074-b59e-4865-a326-f06f2d9af6c0 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1257.693023] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 425be58f-bfee-4ba9-b37e-b5a87a03d564 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1258.195851] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d874183c-7a39-4fdf-bea7-a9f423fb3c09 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1258.698910] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e7eef812-1ad5-45ae-86c6-7fb07fdccce0 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1258.699198] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 11 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 1258.699383] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2688MB phys_disk=100GB used_disk=11GB total_vcpus=48 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '11', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '11', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '2', 'io_workload': '10', 'num_vm_building': '10', 'num_task_deleting': '9', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_task_spawning': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 1259.012183] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-235c8de3-1ec0-48a6-88c4-298fd0423eff {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1259.019559] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-5a9e6109-f105-4e7f-95a8-b53fa2173157 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1259.050183] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1b2425d5-c862-42ee-ab19-ad01e7095b9a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1259.057379] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b35a13ce-93eb-4210-a2ed-f718665ad604 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1259.070553] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 1259.573848] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 1260.078618] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 1260.078820] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 9.961s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1260.079034] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1262.078867] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1262.079204] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1262.079204] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1262.079306] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1262.079368] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1262.079476] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1262.079598] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 1262.079765] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.47 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1269.512285] env[65478]: WARNING nova.utils [None req-a56344e6-9115-4fcd-bd0c-aedaf4fae3c7 tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d9386ebbe0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1284.132247] env[65478]: WARNING nova.utils [None req-78c92650-d8fe-46ce-9f57-ac6c6186d3d2 tempest-AttachInterfacesTestJSON-213904873 tempest-AttachInterfacesTestJSON-213904873-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8dc683640> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1294.724273] env[65478]: WARNING nova.utils [None req-51b95a80-7842-40cb-ae4e-8956c2b8e582 tempest-ServerShowV254Test-25186309 tempest-ServerShowV254Test-25186309-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8dc683be0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1310.549321] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1311.052914] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1311.053717] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1311.053972] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1311.053972] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 1311.055245] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-7660b4b9-7d72-41eb-9083-73a663235584 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1311.063941] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e3de6288-bf30-4c66-87f5-7b4a4885662f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1311.078574] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a17384e7-67bb-40b1-9d99-decae1579e03 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1311.085725] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0a0c06a0-03f7-4be3-acb7-cddcd9f8ea45 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1311.115141] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=181826MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 1311.115285] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1311.115456] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1312.147184] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e4810749-aefd-411e-87c1-5b1b1967538f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1312.149728] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1312.149728] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1312.149728] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1312.149728] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1312.149728] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1312.149728] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1312.149728] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1312.149728] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1312.149728] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1312.149728] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1312.655658] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 9be6233a-13aa-4978-93fd-04327697a4ab has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1313.158777] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d74865e8-e131-4dfa-a8ed-7886d7f33ef1 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1313.662270] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance fd88eace-477d-4b06-99d1-1068aabac135 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1314.164732] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 2c7e9f7a-4212-44da-a54f-9c3de95af6b0 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1314.667308] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance b87b3074-b59e-4865-a326-f06f2d9af6c0 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1315.170114] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 425be58f-bfee-4ba9-b37e-b5a87a03d564 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1315.672740] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d874183c-7a39-4fdf-bea7-a9f423fb3c09 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1316.175561] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e7eef812-1ad5-45ae-86c6-7fb07fdccce0 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1316.678836] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 9417515e-bef8-4b45-ad62-87ed2c7a2e8f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1317.185070] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 85150c98-5ad8-44de-a9b0-e16371d152ca has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1317.690055] env[65478]: WARNING nova.utils [None req-e859fca8-405d-476f-8f68-cae6252eebd7 tempest-ServerActionsTestJSON-982245403 tempest-ServerActionsTestJSON-982245403-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8fc6c7f40> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1317.691294] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 6c182d65-3301-4474-8a93-8a76a43e0d67 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1317.691571] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 11 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 1317.691755] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2688MB phys_disk=100GB used_disk=11GB total_vcpus=48 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '11', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '11', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '2', 'io_workload': '10', 'num_vm_building': '10', 'num_task_deleting': '9', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_task_spawning': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 1317.945780] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-bfdc2095-66fa-4185-b574-f74a6954783d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1317.954421] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-446a3563-66d2-4d33-9216-2bfc81cb1670 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1317.985194] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-7db0d38e-65bd-4e5c-9ab7-21f1b6840c2c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1317.992652] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-96fec276-a024-4efa-aa7b-2e8ac8304f46 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1318.006843] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 1318.510166] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 1318.511491] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 1318.511645] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 7.396s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1318.511837] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1318.623576] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1319.511876] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1319.512090] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1319.512189] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1319.512279] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1319.512863] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1319.512863] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1319.512863] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1319.512863] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 1319.512863] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.03 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1322.544956] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1323.054054] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.49 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1341.491607] env[65478]: WARNING nova.utils [None req-6a1a037c-fef1-4e15-9f82-f54f48b56efb tempest-ServerShowV247Test-529365391 tempest-ServerShowV247Test-529365391-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8dc7597e0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1341.674467] env[65478]: WARNING nova.utils [None req-295c64ad-8b0c-450f-9058-29386da89435 tempest-ServerShowV247Test-529365391 tempest-ServerShowV247Test-529365391-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8fc6c65f0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1372.549417] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1372.549862] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1373.053031] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1373.053031] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1373.053215] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1373.053372] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 1373.054385] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b66319cb-8b1f-418e-86e7-78d9486e13df {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1373.063189] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-77dea288-4346-4557-8033-dd4390c312c6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1373.077673] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c7de47dd-04be-438c-978b-c8b8bbb3f60a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1373.084627] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d7fc9396-248b-4f5f-b737-82fb731c1f98 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1373.113872] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=181819MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 1373.114023] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1373.114191] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1374.149968] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e4810749-aefd-411e-87c1-5b1b1967538f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1374.150263] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1374.150263] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1374.150339] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1374.150490] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1374.151682] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1374.151682] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1374.151682] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1374.151682] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1374.151682] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1374.151682] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1374.654402] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d74865e8-e131-4dfa-a8ed-7886d7f33ef1 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1375.156824] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance fd88eace-477d-4b06-99d1-1068aabac135 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1375.659914] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 2c7e9f7a-4212-44da-a54f-9c3de95af6b0 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1376.163099] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance b87b3074-b59e-4865-a326-f06f2d9af6c0 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1376.666060] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 425be58f-bfee-4ba9-b37e-b5a87a03d564 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1377.170475] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d874183c-7a39-4fdf-bea7-a9f423fb3c09 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1377.673397] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e7eef812-1ad5-45ae-86c6-7fb07fdccce0 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1378.176381] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 9417515e-bef8-4b45-ad62-87ed2c7a2e8f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1378.679612] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 85150c98-5ad8-44de-a9b0-e16371d152ca has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1379.183049] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 6c182d65-3301-4474-8a93-8a76a43e0d67 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1379.685584] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d01984ed-5e8c-481b-ae51-a9da4266f54f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1380.189264] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 50ef3235-0ec8-4b9b-bb3e-f5c56dddb45e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1380.692353] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 82d86b5b-4254-4129-b1f7-6530fcfce840 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1380.692608] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 11 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 1380.692760] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2688MB phys_disk=100GB used_disk=11GB total_vcpus=48 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '11', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '11', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '2', 'io_workload': '10', 'num_vm_building': '10', 'num_task_deleting': '9', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_task_spawning': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 1380.942578] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0ffefee8-d550-4536-b5fd-a4e7ce0b7559 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1380.949334] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-af4f6dc6-a1eb-4b89-ab48-b78809b0c11d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1380.979516] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-39747f92-6646-4fde-8e85-3ac09e2378d0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1380.986472] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-eedfb040-de21-46f5-8c62-c2f50961a9da {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1380.999046] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 1381.502245] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 1381.503856] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 1381.504174] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 8.390s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1381.504444] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1382.504345] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1382.504716] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1382.504716] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1382.504716] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1382.504851] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1382.504889] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1382.505022] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 1382.505253] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.04 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1418.881897] env[65478]: WARNING nova.utils [None req-ba3a4a89-0e6b-4d22-a2f9-fd16eba15e7f tempest-MultipleCreateTestJSON-1602728264 tempest-MultipleCreateTestJSON-1602728264-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8dc681a20> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1418.930015] env[65478]: WARNING nova.utils [None req-ba3a4a89-0e6b-4d22-a2f9-fd16eba15e7f tempest-MultipleCreateTestJSON-1602728264 tempest-MultipleCreateTestJSON-1602728264-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8dc6836d0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1419.611042] env[65478]: DEBUG oslo_concurrency.lockutils [None req-d1aca656-db39-4a60-87ef-feeef8ed3c7c tempest-ListServerFiltersTestJSON-1638126877 tempest-ListServerFiltersTestJSON-1638126877-project-member] Acquiring lock "d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1420.213036] env[65478]: WARNING nova.utils [None req-f0880c5f-b92e-43e4-959f-4eed10c20148 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8fc6c44c0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1422.876070] env[65478]: WARNING nova.utils [None req-e564db8f-c0d2-4ebc-be9c-8e64e1200f37 tempest-ServerShowV257Test-977550425 tempest-ServerShowV257Test-977550425-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8fc6c5990> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1425.613434] env[65478]: WARNING nova.utils [None req-fdea1e97-3eac-491c-9f2e-a99e1df049ab tempest-ImagesTestJSON-212743090 tempest-ImagesTestJSON-212743090-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8dc682f80> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1431.773244] env[65478]: WARNING nova.utils [None req-9f8c4672-07a9-452a-b811-8e8c2193f0eb tempest-ServerDiskConfigTestJSON-1007286184 tempest-ServerDiskConfigTestJSON-1007286184-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8dc680550> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1432.549502] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1432.549724] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1434.549240] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1434.549518] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1435.052592] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1435.052893] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1435.053076] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1435.053228] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 1435.054187] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d0a04e8d-46ad-464a-a5e3-6840fc858baf {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1435.062623] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9c61a15c-509e-4f3f-b189-94b0cbd4fa5c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1435.079252] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9b02eaa0-1173-443a-bf54-b07b022581b1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1435.085855] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3ceabf39-6eab-48c6-aa8c-3a8a3621dfe6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1435.115396] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=181824MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 1435.115541] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1435.115694] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1436.144415] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e4810749-aefd-411e-87c1-5b1b1967538f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1436.144687] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1436.144687] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1436.144769] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1436.144874] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1436.144975] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1436.145088] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1436.145187] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1436.145286] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1436.145379] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1436.145474] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1436.649023] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 9417515e-bef8-4b45-ad62-87ed2c7a2e8f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1437.152191] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 85150c98-5ad8-44de-a9b0-e16371d152ca has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1437.655450] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 6c182d65-3301-4474-8a93-8a76a43e0d67 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1438.158529] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d01984ed-5e8c-481b-ae51-a9da4266f54f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1438.626394] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1438.660862] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 50ef3235-0ec8-4b9b-bb3e-f5c56dddb45e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1439.163850] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 82d86b5b-4254-4129-b1f7-6530fcfce840 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1439.667030] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 66f63b70-a529-4d6c-b86c-d0c1df0e7570 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1440.169782] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 37dcd033-ddf6-46ae-9e20-40c8a3491d4c has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1440.672740] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 660ee0c5-c47a-4639-bcf9-be5477a536dc has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1441.175675] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 1a1fa913-4ff5-40e2-8a7d-64b4e522c1f9 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1441.679090] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance a11fb9ae-c392-4a8c-b2ef-821507f93573 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1442.181819] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 5a333d54-fc1f-498e-88ef-d49d8d877cbb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1442.182173] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 11 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 1442.182223] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2688MB phys_disk=100GB used_disk=11GB total_vcpus=48 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '11', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '11', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '2', 'io_workload': '10', 'num_vm_building': '10', 'num_task_deleting': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 1442.431281] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0c25c9aa-d912-4ef4-bbaa-13d3cbce2393 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1442.438389] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-810e2054-9cc2-43c9-8ddc-01910f07f5e2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1442.467977] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c9fc1433-7032-4799-a224-548d140de567 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1442.475879] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b16b4417-48c6-4bba-b04e-494c6bb41a8d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1442.492010] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 1442.995015] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 1443.500018] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 1443.500401] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 8.384s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1443.500520] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1444.495670] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1444.495843] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1444.495843] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1444.495947] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1444.496096] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1444.496245] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 1444.496411] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.05 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1446.545058] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1447.050832] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1466.329418] env[65478]: WARNING nova.utils [None req-d6c288fd-d350-45fe-baf7-dc0b4deae00c tempest-DeleteServersTestJSON-35602450 tempest-DeleteServersTestJSON-35602450-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d93a96e560> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1481.066806] env[65478]: WARNING nova.utils [None req-784ae1e9-1abc-4633-bf06-7c6220e9dbe3 tempest-AttachInterfacesTestJSON-213904873 tempest-AttachInterfacesTestJSON-213904873-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8fc6c4f70> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1492.549683] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1492.550071] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Cleaning up deleted instances {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11960}}
[ 1493.053269] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] There are 0 instances to clean {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11969}}
[ 1493.053447] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1493.555854] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1494.555552] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1494.555817] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1494.555868] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1496.549339] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1496.549726] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1496.549726] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1496.549726] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 1496.549726] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1497.053820] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1497.054022] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1497.054182] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1497.054321] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 1497.055316] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-303ab286-1e05-4eb0-972e-433c177d9d2d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1497.064486] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d36bcfed-731e-4c9d-ae98-dcef48447b83 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1497.078759] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e3a2b884-672f-4132-90f3-35e002786f75 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1497.086694] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-bb7a3500-04a4-40f8-b9ba-5b6cafcbc2c4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1497.115798] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=181828MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 1497.115973] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1497.116111] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1498.271949] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e4810749-aefd-411e-87c1-5b1b1967538f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1498.272253] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1498.272253] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1498.272315] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1498.272397] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1498.272501] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1498.272603] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1498.272704] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1498.272805] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1498.272902] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1498.272999] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1498.776020] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d01984ed-5e8c-481b-ae51-a9da4266f54f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1499.278907] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 50ef3235-0ec8-4b9b-bb3e-f5c56dddb45e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1499.781867] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 82d86b5b-4254-4129-b1f7-6530fcfce840 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1500.284764] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 66f63b70-a529-4d6c-b86c-d0c1df0e7570 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1500.787807] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 37dcd033-ddf6-46ae-9e20-40c8a3491d4c has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1501.290869] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 660ee0c5-c47a-4639-bcf9-be5477a536dc has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1501.794634] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 1a1fa913-4ff5-40e2-8a7d-64b4e522c1f9 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1502.297689] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance a11fb9ae-c392-4a8c-b2ef-821507f93573 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1502.800915] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 5a333d54-fc1f-498e-88ef-d49d8d877cbb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1503.303727] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance a1d3e0ca-d9e8-436d-99c2-515d78b1ad59 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1503.806120] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 5b7258eb-589d-4fb3-83be-c3913e020f5e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1503.806388] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 11 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 1503.806542] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2688MB phys_disk=100GB used_disk=11GB total_vcpus=48 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '11', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '11', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '2', 'io_workload': '10', 'num_vm_building': '10', 'num_task_deleting': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 1503.822969] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Refreshing inventories for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
[ 1503.837623] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Updating ProviderTree inventory for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
[ 1503.837801] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[ 1503.848678] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Refreshing aggregate associations for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5, aggregates: None {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
[ 1503.868263] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Refreshing trait associations for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_VMDK,COMPUTE_IMAGE_TYPE_ISO,HW_ARCH_X86_64,COMPUTE_SAME_HOST_COLD_MIGRATE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
[ 1504.092543] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-bc38f6c8-a939-40e7-a3a5-4119550afc20 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1504.099806] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1218c230-f83c-44d1-bc3d-45bffee3bfa9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1504.129932] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-7e55cb4d-d85f-4ba2-a7a2-22aff1275fa9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1504.137450] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0d0c1320-d916-4743-b448-8e3abecb8a5b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1504.152246] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 1504.655310] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 1504.656676] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 1504.656831] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 7.541s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1504.656980] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1504.657114] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Cleaning up deleted instances with incomplete migration  {{(pid=65478) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11998}}
[ 1505.159635] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1506.154736] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1506.155127] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1506.155127] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.39 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1554.549333] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1554.549785] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1555.549293] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1555.549519] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1556.549359] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1556.549525] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1557.052719] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1557.052906] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1557.053073] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1557.053219] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 1557.054244] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d7f17bbc-355f-42d5-b3d2-8a0a94382f9c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1557.063011] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b31138e8-d5bb-4799-9cb3-e9fbf6e419f4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1557.077138] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0ddffe7f-9dc8-4432-8e20-feb5590dadeb {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1557.083973] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-bc5d4978-0bcd-4e72-9d6a-ebc4043b6f2b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1557.113397] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=181835MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 1557.113560] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1557.113708] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1558.145488] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e4810749-aefd-411e-87c1-5b1b1967538f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1558.145793] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1558.145793] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1558.145861] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1558.145964] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1558.146266] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1558.146421] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1558.146559] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1558.146690] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1558.146817] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1558.146944] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1558.629750] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1558.650014] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 66f63b70-a529-4d6c-b86c-d0c1df0e7570 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1559.153320] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 37dcd033-ddf6-46ae-9e20-40c8a3491d4c has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1559.656327] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 660ee0c5-c47a-4639-bcf9-be5477a536dc has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1560.159308] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 1a1fa913-4ff5-40e2-8a7d-64b4e522c1f9 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1560.664146] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance a11fb9ae-c392-4a8c-b2ef-821507f93573 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1561.168648] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 5a333d54-fc1f-498e-88ef-d49d8d877cbb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1561.673043] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance a1d3e0ca-d9e8-436d-99c2-515d78b1ad59 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1562.175457] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 5b7258eb-589d-4fb3-83be-c3913e020f5e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1562.175879] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 11 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 1562.175928] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2688MB phys_disk=100GB used_disk=11GB total_vcpus=48 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '11', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '11', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '2', 'io_workload': '10', 'num_vm_building': '10', 'num_task_deleting': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 1562.411438] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e3907cf6-6ac2-40b9-89c5-9de25050a9f3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1562.419252] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e2f3e63d-9972-4761-894f-47c5b8df61c8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1562.451864] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-aa01b057-7831-409f-97fd-db085b412088 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1562.459509] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-fa2b2648-5d7c-4297-ba3f-ec641dadd78d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1562.472933] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 1562.976231] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 1562.977588] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 1562.977752] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 5.864s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1562.978028] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1563.978457] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1563.978457] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1563.978457] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1563.978457] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1563.978457] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 1563.978457] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 7.57 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1571.544729] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1572.050969] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 43.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1615.549333] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1615.549840] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1616.549330] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1616.549547] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1617.549239] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1617.549550] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1618.053046] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1618.053046] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1618.053046] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1618.053046] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 1618.053705] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-131a1656-b3fb-4060-9a0d-f3b34e6d1ec5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1618.061657] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6c9f2de6-d05e-4956-b128-2db1d10f286e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1618.077468] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0961e74f-8bba-4b7a-932b-4a25c6bc1aaa {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1618.085530] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-85841cf4-307f-410b-811a-380481a8da6c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1618.119119] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=181836MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 1618.119276] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1618.119458] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1619.150846] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e4810749-aefd-411e-87c1-5b1b1967538f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1619.151348] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1619.151348] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1619.151348] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1619.151348] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1619.151544] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1619.151577] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1619.151702] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1619.151785] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1619.152332] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1619.152332] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1619.239077] env[65478]: WARNING nova.utils [None req-b6ae7b19-3d28-43e0-b444-f65a86321e79 tempest-ServerRescueTestJSONUnderV235-456478059 tempest-ServerRescueTestJSONUnderV235-456478059-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d93bb6da20> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1619.655445] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance a11fb9ae-c392-4a8c-b2ef-821507f93573 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1620.159069] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 5a333d54-fc1f-498e-88ef-d49d8d877cbb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1620.662063] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance a1d3e0ca-d9e8-436d-99c2-515d78b1ad59 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1621.165028] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 5b7258eb-589d-4fb3-83be-c3913e020f5e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1621.667856] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 5646aeb3-71fb-4484-a9d7-ba29a610403d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1621.668121] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 11 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 1621.668276] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2688MB phys_disk=100GB used_disk=11GB total_vcpus=48 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '11', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '11', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '2', 'io_workload': '10', 'num_vm_building': '10', 'num_task_deleting': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 1621.844185] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a23e961a-8122-44a3-a119-154545629535 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1621.851353] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b2eb8a39-78a2-4401-9433-137e6fb17efa {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1621.882596] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ff060f72-377c-4103-a44a-1c15325c2f9d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1621.889568] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a54be558-4bed-453f-b9a9-02bd0ea35913 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1621.902408] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 1622.180292] env[65478]: WARNING nova.utils [None req-5e8d7105-b30e-45fc-8ab1-5ae91064f263 tempest-ImagesTestJSON-212743090 tempest-ImagesTestJSON-212743090-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d93aaf37f0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1622.407034] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 1622.408377] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 1622.408539] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.289s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1622.409147] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1623.408396] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1623.408666] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1623.408666] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1623.409497] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1623.409497] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 1623.409497] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 52.14 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1625.124194] env[65478]: WARNING nova.utils [None req-b4fc5d8e-41fd-48f6-9ba2-8b244da3fd5d tempest-AttachVolumeShelveTestJSON-1861800605 tempest-AttachVolumeShelveTestJSON-1861800605-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8dc758c10> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1627.464032] env[65478]: WARNING nova.utils [None req-4df595a5-c0c7-4036-b35d-220cb559ae93 tempest-ServerDiskConfigTestJSON-1007286184 tempest-ServerDiskConfigTestJSON-1007286184-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8dc75a5f0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1636.637282] env[65478]: WARNING nova.utils [None req-07d174dc-4404-408d-8009-812da570d2e1 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d93a96f6d0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1675.549562] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1675.549957] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1678.549268] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1678.549638] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1678.633269] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1679.549209] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1679.549391] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1679.549654] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1679.549654] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 1679.549754] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1679.638179] env[65478]: WARNING nova.utils [None req-052c7f33-30b2-42ee-b47b-2d430f2ee070 tempest-AttachInterfacesTestJSON-213904873 tempest-AttachInterfacesTestJSON-213904873-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8fc6c64d0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1680.053038] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1680.053226] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1680.053325] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1680.053468] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 1680.054458] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-2af9cada-fd1e-47a0-9244-f52172d1ee22 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1680.062458] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-2c797f27-594c-49d6-980f-61475b860816 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1680.076578] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-024aa985-94be-43ee-9f7c-7970891c40a3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1680.084021] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-15ab4306-4d6f-4ebb-a1f1-ffb6c4bc2bb2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1680.115049] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=181823MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 1680.115206] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1680.115383] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1681.152209] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e4810749-aefd-411e-87c1-5b1b1967538f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1681.152508] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1681.152564] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1681.152700] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1681.152830] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1681.152971] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1681.153116] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1681.153243] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1681.153366] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1681.153488] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1681.153591] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1681.656566] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 5646aeb3-71fb-4484-a9d7-ba29a610403d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1682.159517] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 16e50451-e636-49e7-b88f-c164223973b3 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1682.662546] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 46cc2466-f705-435c-a35a-628e8884ee7f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1683.165526] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance bec57f07-07e3-4273-b196-701dd5564419 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1683.668519] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 41017449-7583-4e3a-925c-43778df28e0b has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1684.171475] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 577af425-9e7f-4329-bd75-b1785e7e33ac has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1684.171914] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 11 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 1684.171914] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2688MB phys_disk=100GB used_disk=11GB total_vcpus=48 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '11', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '11', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '2', 'io_workload': '10', 'num_vm_building': '10', 'num_task_deleting': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 1684.393657] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-00162e61-58a2-4cd1-bfc3-392a0f6029ae {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1684.401678] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ac4b1540-1ddf-4ae8-84ac-f494ff4aef6e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1684.433355] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-be00594d-ad91-4d57-b079-7c27d67e4701 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1684.440599] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a1f17400-4316-483e-ad09-d6dc314353ac {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1684.453874] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 1684.957094] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 1684.958389] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 1684.958560] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.843s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1684.958742] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1685.953866] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1685.954255] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1685.954290] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 9.59 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1695.544634] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1696.050981] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 40.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1736.549668] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1736.549933] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1739.549219] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1739.549628] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1740.549408] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1740.549764] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1740.549764] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 1740.549764] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1741.549213] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1741.549354] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1742.052161] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1742.052564] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1742.052564] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1742.052662] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 1742.053642] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a12c114b-6cd8-49b7-853e-5e5c3babed61 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1742.061472] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0c7317c2-f87f-422f-94e5-90df352042dc {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1742.075176] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ffd15939-53bd-4ac9-8285-de15beff8456 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1742.081679] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-bae01fce-72b9-431a-9774-23c0ec3a628e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1742.111900] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=181827MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 1742.112044] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1742.112205] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1743.145793] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e4810749-aefd-411e-87c1-5b1b1967538f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1743.146108] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1743.146108] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1743.146233] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1743.146233] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1743.146332] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1743.146431] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1743.146529] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1743.146630] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1743.146725] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1743.146820] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1743.649707] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 5646aeb3-71fb-4484-a9d7-ba29a610403d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1744.152489] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 16e50451-e636-49e7-b88f-c164223973b3 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1744.655999] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 46cc2466-f705-435c-a35a-628e8884ee7f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1745.158859] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance bec57f07-07e3-4273-b196-701dd5564419 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1745.661809] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 41017449-7583-4e3a-925c-43778df28e0b has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1746.165070] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 577af425-9e7f-4329-bd75-b1785e7e33ac has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1746.165456] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 11 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 1746.165456] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2688MB phys_disk=100GB used_disk=11GB total_vcpus=48 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '11', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '11', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '2', 'io_workload': '10', 'num_vm_building': '10', 'num_task_deleting': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 1746.346954] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-da9630d2-f86e-4ce4-88fa-15c08f0fc779 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1746.353993] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-dde8ee58-0df5-48d9-8d20-4f9dd2c39932 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1746.384173] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b043f027-c1cf-4004-a219-6bda465bc167 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1746.391484] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-de45260d-bfa1-4a9f-bc66-292063149ac9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1746.404536] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 1746.907610] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 1746.909634] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 1746.909883] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.798s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1746.910210] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1747.905352] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1747.905799] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1747.905799] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.64 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1797.549502] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1797.549502] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1798.636461] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1800.549297] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1800.549692] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 1800.549692] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1801.549607] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1801.549898] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1801.549956] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1802.544567] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1802.544807] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1802.549071] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1802.549241] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1803.052285] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1803.052496] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1803.052648] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1803.052798] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 1803.053791] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e21e6796-af47-4bfd-9e2b-352e9d20a188 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1803.061706] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-fff7a051-7d93-4bf8-91c2-c804dbd20c9e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1803.075731] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-351b234f-3b2e-45d1-9ce9-f06a7756590e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1803.082368] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-bcb36549-3a9c-4aa6-83c7-f7ab6eeda137 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1803.112512] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=181817MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 1803.112641] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1803.112815] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1804.193067] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e4810749-aefd-411e-87c1-5b1b1967538f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1804.193435] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1804.193435] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1804.193519] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1804.193641] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1804.193754] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1804.193859] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1804.194032] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1804.194166] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1804.194267] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1804.194396] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1804.697523] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 5646aeb3-71fb-4484-a9d7-ba29a610403d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1805.200583] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 16e50451-e636-49e7-b88f-c164223973b3 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1805.703675] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 46cc2466-f705-435c-a35a-628e8884ee7f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1806.206548] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance bec57f07-07e3-4273-b196-701dd5564419 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1806.709578] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 41017449-7583-4e3a-925c-43778df28e0b has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1807.215024] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 577af425-9e7f-4329-bd75-b1785e7e33ac has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1807.215438] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 11 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 1807.215438] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2688MB phys_disk=100GB used_disk=11GB total_vcpus=48 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '11', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '11', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '2', 'io_workload': '10', 'num_vm_building': '10', 'num_task_deleting': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 1807.232012] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Refreshing inventories for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
[ 1807.244623] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Updating ProviderTree inventory for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
[ 1807.244779] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[ 1807.254518] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Refreshing aggregate associations for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5, aggregates: None {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
[ 1807.273645] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Refreshing trait associations for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_VMDK,COMPUTE_IMAGE_TYPE_ISO,HW_ARCH_X86_64,COMPUTE_SAME_HOST_COLD_MIGRATE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
[ 1807.456881] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-da7ec6c4-3fe5-4f91-9d46-363c35429125 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1807.464374] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1d8a606a-6cdf-4818-8b1a-d544f954569b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1807.496191] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-525afc73-209b-4bab-b86c-6570f948e826 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1807.503335] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-838ee17d-4899-4df8-8c69-876b535850f0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1807.516416] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 1808.019522] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 1808.020888] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 1808.021073] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.908s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1808.021249] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1808.021368] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Cleaning up deleted instances {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11960}}
[ 1808.524136] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] There are 0 instances to clean {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11969}}
[ 1808.524515] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1808.524515] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Cleaning up deleted instances with incomplete migration  {{(pid=65478) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11998}}
[ 1809.027255] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1809.529516] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1811.529641] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1811.529906] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.01 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1816.545054] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1817.050796] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 41.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1822.820036] env[65478]: WARNING nova.utils [None req-a623f037-053f-40b5-8566-b8b6a7142b36 tempest-AttachVolumeShelveTestJSON-1861800605 tempest-AttachVolumeShelveTestJSON-1861800605-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d920180b80> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1823.261532] env[65478]: WARNING nova.utils [None req-21376284-b609-4f12-9286-1a1783242b3f tempest-AttachInterfacesV270Test-1795509320 tempest-AttachInterfacesV270Test-1795509320-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d93aaa71c0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1824.023749] env[65478]: WARNING nova.utils [None req-f881d694-63c3-4987-892e-1c2e32bef769 tempest-ServerDiskConfigTestJSON-1007286184 tempest-ServerDiskConfigTestJSON-1007286184-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8dc680e50> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1833.670334] env[65478]: DEBUG oslo_concurrency.lockutils [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Acquiring lock "e4810749-aefd-411e-87c1-5b1b1967538f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1833.670720] env[65478]: DEBUG oslo_concurrency.lockutils [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Lock "e4810749-aefd-411e-87c1-5b1b1967538f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1833.670768] env[65478]: DEBUG oslo_concurrency.lockutils [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Acquiring lock "e4810749-aefd-411e-87c1-5b1b1967538f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1833.670876] env[65478]: DEBUG oslo_concurrency.lockutils [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Lock "e4810749-aefd-411e-87c1-5b1b1967538f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1833.671009] env[65478]: DEBUG oslo_concurrency.lockutils [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Lock "e4810749-aefd-411e-87c1-5b1b1967538f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1833.673742] env[65478]: INFO nova.compute.manager [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Terminating instance
[ 1834.177367] env[65478]: DEBUG nova.compute.manager [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Start destroying the instance on the hypervisor. {{(pid=65478) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}}
[ 1834.177569] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Destroying instance {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1141}}
[ 1834.178659] env[65478]: DEBUG oslo_vmware.service [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-182506ad-8419-488f-817d-13edac430bd4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1834.185981] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Powering off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1512}}
[ 1834.186214] env[65478]: DEBUG oslo_vmware.service [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking VirtualMachine.PowerOffVM_Task with opID=oslo.vmware-ebd85ea3-64d5-424c-b69b-cf3f8955d43e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1834.192222] env[65478]: DEBUG oslo_vmware.api [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Waiting for the task: (returnval){
[ 1834.192222] env[65478]:    value = "task-6011925"
[ 1834.192222] env[65478]:    _type = "Task"
[ 1834.192222] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1834.199522] env[65478]: DEBUG oslo_vmware.api [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Task: {'id': task-6011925, 'name': PowerOffVM_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1834.701749] env[65478]: DEBUG oslo_vmware.api [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Task: {'id': task-6011925, 'name': PowerOffVM_Task, 'duration_secs': 0.175177} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1834.702142] env[65478]: DEBUG nova.virt.vmwareapi.vm_util [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Powered off the VM {{(pid=65478) power_off_instance /opt/stack/nova/nova/virt/vmwareapi/vm_util.py:1517}}
[ 1834.702142] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Unregistering the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1093}}
[ 1834.702300] env[65478]: DEBUG oslo_vmware.service [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking VirtualMachine.UnregisterVM with opID=oslo.vmware-179384fa-6037-43d2-96c3-4fc4f72e1b62 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1834.769063] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Unregistered the VM {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1096}}
[ 1834.769258] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Deleting contents of the VM from datastore datastore2 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1106}}
[ 1834.769436] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Deleting the datastore file [datastore2] e4810749-aefd-411e-87c1-5b1b1967538f {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:211}}
[ 1834.769749] env[65478]: DEBUG oslo_vmware.service [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking FileManager.DeleteDatastoreFile_Task with opID=oslo.vmware-55029d06-bf52-4719-8145-ed29c1d8fc50 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1834.777846] env[65478]: DEBUG oslo_vmware.api [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Waiting for the task: (returnval){
[ 1834.777846] env[65478]:    value = "task-6011927"
[ 1834.777846] env[65478]:    _type = "Task"
[ 1834.777846] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 1834.785152] env[65478]: DEBUG oslo_vmware.api [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Task: {'id': task-6011927, 'name': DeleteDatastoreFile_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 1835.288120] env[65478]: DEBUG oslo_vmware.api [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Task: {'id': task-6011927, 'name': DeleteDatastoreFile_Task, 'duration_secs': 0.129697} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 1835.288120] env[65478]: DEBUG nova.virt.vmwareapi.ds_util [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Deleted the datastore file {{(pid=65478) file_delete /opt/stack/nova/nova/virt/vmwareapi/ds_util.py:220}}
[ 1835.288120] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Deleted contents of the VM from datastore datastore2 {{(pid=65478) _destroy_instance /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1116}}
[ 1835.288383] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Instance destroyed {{(pid=65478) destroy /opt/stack/nova/nova/virt/vmwareapi/vmops.py:1143}}
[ 1835.288383] env[65478]: INFO nova.compute.manager [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Took 1.11 seconds to destroy the instance on the hypervisor.
[ 1835.288910] env[65478]: DEBUG oslo.service.backend._common.loopingcall [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=65478) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
[ 1835.289196] env[65478]: DEBUG nova.compute.manager [-] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Deallocating network for instance {{(pid=65478) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}}
[ 1835.289356] env[65478]: DEBUG nova.network.neutron [-] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] deallocate_for_instance() {{(pid=65478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
[ 1835.289686] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[ 1835.378901] env[65478]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
[ 1835.851411] env[65478]: DEBUG nova.compute.manager [req-4940f156-eb43-459d-bd15-85588a3facea req-893edabc-5737-4379-b3c1-2d4df3b1545f service nova] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Received event network-vif-deleted-77d4d422-ea65-4577-ae8a-77615259cfb1 {{(pid=65478) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}}
[ 1835.851659] env[65478]: INFO nova.compute.manager [req-4940f156-eb43-459d-bd15-85588a3facea req-893edabc-5737-4379-b3c1-2d4df3b1545f service nova] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Neutron deleted interface 77d4d422-ea65-4577-ae8a-77615259cfb1; detaching it from the instance and deleting it from the info cache
[ 1835.851659] env[65478]: DEBUG nova.network.neutron [req-4940f156-eb43-459d-bd15-85588a3facea req-893edabc-5737-4379-b3c1-2d4df3b1545f service nova] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[ 1836.304669] env[65478]: DEBUG nova.network.neutron [-] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Updating instance_info_cache with network_info: [] {{(pid=65478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
[ 1836.355497] env[65478]: DEBUG oslo_vmware.service [req-4940f156-eb43-459d-bd15-85588a3facea req-893edabc-5737-4379-b3c1-2d4df3b1545f service nova] Invoking SearchIndex.FindAllByUuid with opID=oslo.vmware-19a90802-5b16-458a-a019-8c149dda534e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1836.364896] env[65478]: DEBUG oslo_vmware.service [req-4940f156-eb43-459d-bd15-85588a3facea req-893edabc-5737-4379-b3c1-2d4df3b1545f service nova] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-7855504f-849b-449e-ba29-b9b43bdcc9cd {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1836.391838] env[65478]: DEBUG nova.compute.manager [req-4940f156-eb43-459d-bd15-85588a3facea req-893edabc-5737-4379-b3c1-2d4df3b1545f service nova] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Detach interface failed, port_id=77d4d422-ea65-4577-ae8a-77615259cfb1, reason: Instance e4810749-aefd-411e-87c1-5b1b1967538f could not be found. {{(pid=65478) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}}
[ 1836.807850] env[65478]: INFO nova.compute.manager [-] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Took 1.52 seconds to deallocate network for instance.
[ 1837.314965] env[65478]: DEBUG oslo_concurrency.lockutils [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1837.314965] env[65478]: DEBUG oslo_concurrency.lockutils [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1837.314965] env[65478]: DEBUG nova.objects.instance [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Lazy-loading 'resources' on Instance uuid e4810749-aefd-411e-87c1-5b1b1967538f {{(pid=65478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
[ 1837.980581] env[65478]: DEBUG oslo_vmware.service [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e0e79397-5b56-4eec-91e4-d080816ce844 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1837.987912] env[65478]: DEBUG oslo_vmware.service [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3dc42bcd-3054-4f54-99a5-80aeaf5829be {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1838.019717] env[65478]: DEBUG oslo_vmware.service [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-588a03cc-7c67-49e6-9313-7b122c679e53 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1838.026759] env[65478]: DEBUG oslo_vmware.service [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-471706b6-915f-404a-bc9f-f38840d376a7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1838.039680] env[65478]: DEBUG nova.compute.provider_tree [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 1838.542688] env[65478]: DEBUG nova.scheduler.client.report [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 1839.047629] env[65478]: DEBUG oslo_concurrency.lockutils [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.733s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1839.064913] env[65478]: INFO nova.scheduler.client.report [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Deleted allocations for instance e4810749-aefd-411e-87c1-5b1b1967538f
[ 1839.572549] env[65478]: DEBUG oslo_concurrency.lockutils [None req-30235b1a-653d-46b3-b448-7c3ddd03e930 tempest-ServerActionsTestOtherA-1974477398 tempest-ServerActionsTestOtherA-1974477398-project-member] Lock "e4810749-aefd-411e-87c1-5b1b1967538f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.902s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1845.151809] env[65478]: WARNING nova.utils [None req-ec0c44de-6bbf-46f2-8779-a165432927c2 tempest-ServerRescueTestJSON-1950753977 tempest-ServerRescueTestJSON-1950753977-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d9201817e0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 1858.549370] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1858.549798] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1861.549484] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1861.549788] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1862.549248] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1862.549434] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 1862.549585] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.56 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1863.109537] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._sync_power_states {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1863.614285] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Getting list of instances from cluster (obj){
[ 1863.614285] env[65478]:    value = "domain-c8"
[ 1863.614285] env[65478]:    _type = "ClusterComputeResource"
[ 1863.614285] env[65478]:  } {{(pid=65478) list_instances /opt/stack/nova/nova/virt/vmwareapi/vmops.py:2116}}
[ 1863.615458] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-50a2220f-4724-43b5-9082-81a86f9e9283 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1863.624318] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Got total of 0 instances {{(pid=65478) list_instances /opt/stack/nova/nova/virt/vmwareapi/vmops.py:2125}}
[ 1863.624498] env[65478]: WARNING nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] While synchronizing instance power states, found 10 instances in the database and 0 instances on the hypervisor.
[ 1863.624594] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Sync already in progress for 77a0e8c4-b77a-45b9-a249-d98866d4048a {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11069}}
[ 1863.624713] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Sync already in progress for 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11069}}
[ 1863.624824] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Sync already in progress for d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11069}}
[ 1863.624932] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Sync already in progress for 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11069}}
[ 1863.625054] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Sync already in progress for d4d3cf75-1781-46ed-afb2-44e6f2c048e2 {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11069}}
[ 1863.625164] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Sync already in progress for ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11069}}
[ 1863.625270] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Sync already in progress for 25ec70f9-947b-4ebe-82df-1a1ddcc59360 {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11069}}
[ 1863.625377] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Sync already in progress for 8d032b6f-86df-4397-8727-d4336f973368 {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11069}}
[ 1863.625484] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Sync already in progress for e2e07720-a241-4382-a684-0835b199e37d {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11069}}
[ 1863.625617] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Sync already in progress for 28d4751c-5d09-422a-84b1-e82df32f6b4d {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11069}}
[ 1863.625767] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1864.128728] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1864.129462] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1864.129462] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1864.129462] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 1864.130291] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-bddac990-7fbb-4511-85c3-46c008d0ccc3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1864.138823] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-98a937e6-a0b9-448d-b67d-aa2ee8e0fe6c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1864.154525] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-019510b5-3ea1-4b8c-8fec-696397581db7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1864.164408] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ab9ab069-c32f-436d-8dfa-37767961a141 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1864.196437] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=181988MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 1864.196622] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1864.196743] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1865.225877] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1865.226184] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1865.226184] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1865.226269] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1865.226334] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1865.226435] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1865.226533] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1865.226628] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1865.226723] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1865.226817] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1865.729749] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 577af425-9e7f-4329-bd75-b1785e7e33ac has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1866.232704] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance f8152375-c144-47df-ad66-d5f692173dda has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1866.735793] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance cb29a027-2715-407a-8ac4-f9d60fac2539 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1867.238660] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 607c839b-209e-47a5-a9a9-8125813f93ab has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1867.741790] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance c818a593-873d-48bb-812a-85c49eee8eb4 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1867.742079] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 10 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 1867.742228] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2496MB phys_disk=100GB used_disk=10GB total_vcpus=48 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '10', 'num_vm_building': '10', 'num_task_deleting': '10', 'num_os_type_None': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'io_workload': '10', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 1867.915560] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-648a0066-9fb8-4980-a0b2-b5ab93e7eb1f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1867.922770] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-42606e29-545a-408d-b52e-b230aa0a67a1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1867.952749] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-80680e53-a49e-4b09-98b0-89351d89bdbc {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1867.959860] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-218dd728-fdb3-4de4-883d-775947091194 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1867.972699] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 1868.475852] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 1868.980744] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 1868.980928] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.784s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1868.981140] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.44 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1869.421093] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1869.421093] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1869.421316] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1869.421316] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1869.421454] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.13 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1918.639537] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1919.549469] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1919.549786] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1921.549715] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1921.550128] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1922.549307] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1922.549498] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 1922.549616] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1923.549267] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1924.053071] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1924.053071] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1924.053071] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1924.053333] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 1924.054159] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-bee591f2-e7ae-429d-a034-0cf8f12f7de4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1924.063469] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d011a631-7676-46ab-a486-dfe0bf790fda {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1924.077799] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-308b4d35-d4e4-4d52-a737-4f53e21773cd {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1924.084870] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6f33cc02-cb46-476f-84d5-2fc9960f8136 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1924.114277] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=181996MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 1924.114484] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1924.114531] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1925.143668] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1925.143962] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1925.143962] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1925.144099] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1925.144222] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1925.144325] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1925.144425] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1925.144523] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1925.144651] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1925.144788] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1925.647659] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance f8152375-c144-47df-ad66-d5f692173dda has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1926.150568] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance cb29a027-2715-407a-8ac4-f9d60fac2539 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1926.653466] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 607c839b-209e-47a5-a9a9-8125813f93ab has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1927.155970] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance c818a593-873d-48bb-812a-85c49eee8eb4 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1927.156382] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 10 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 1927.156382] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2496MB phys_disk=100GB used_disk=10GB total_vcpus=48 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '10', 'num_vm_building': '10', 'num_task_deleting': '10', 'num_os_type_None': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'io_workload': '10', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 1927.315287] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a0f2ea86-04f5-417d-a05a-e58f16463c8f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1927.322565] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a62ee030-e654-4247-9843-66c7e2cc14d7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1927.353192] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-76a2199e-46fd-47b5-9846-da93989164b4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1927.360273] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f80d889e-9eaa-4ab5-9436-1fbab58a52db {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1927.373014] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 1927.876173] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 1927.877545] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 1927.877714] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.763s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1927.877908] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1928.872999] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1928.873324] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1928.873324] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1928.873426] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1928.873600] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 12.67 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1941.544631] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1942.050660] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 38.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1980.549309] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1980.549689] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1981.549526] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1981.549942] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1983.549242] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1983.549740] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 1983.549740] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1984.549656] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1984.550079] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1985.549263] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1985.549469] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1985.549530] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1986.052815] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1986.053217] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1986.053217] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1986.053359] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 1986.054342] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d822afbe-ec3e-475e-ad27-5b896218f2c4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1986.062427] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-df690e35-3204-49d3-885f-aee865593989 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1986.076479] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-fc70526a-de42-4d83-8038-e6f89917c9f2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1986.083151] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-706132cc-94d3-4eb8-938a-cf04a790ace9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1986.113709] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=182000MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 1986.113928] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 1986.114040] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 1987.140468] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1987.140777] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1987.140777] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1987.140777] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1987.140893] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1987.140978] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1987.141090] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1987.141187] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1987.141283] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1987.141377] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 1987.644377] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance f8152375-c144-47df-ad66-d5f692173dda has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1988.147349] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance cb29a027-2715-407a-8ac4-f9d60fac2539 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1988.650254] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 607c839b-209e-47a5-a9a9-8125813f93ab has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1989.153252] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance c818a593-873d-48bb-812a-85c49eee8eb4 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 1989.153682] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 10 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 1989.153723] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2496MB phys_disk=100GB used_disk=10GB total_vcpus=48 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '10', 'num_vm_building': '10', 'num_task_deleting': '10', 'num_os_type_None': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'io_workload': '10', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 1989.309397] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ecf722ff-6c4d-4aae-b30c-5f9fb0380e2d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1989.316564] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3d16fcd4-cafa-4f65-a347-f8f00eafa83a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1989.346654] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-52af01e5-5c86-4f1d-9482-66e5273e9cd6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1989.353401] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ae8f5d93-6fe0-4e93-ac40-10807e1a4cf4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 1989.366974] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 1989.870090] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 1989.871428] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 1989.871603] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.758s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 1989.871782] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 1990.866896] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 1990.867291] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.68 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2024.998705] env[65478]: WARNING nova.utils [None req-e900eac4-5f88-47b6-8ac7-6ddfb20a9920 tempest-ServersTestJSON-1629472790 tempest-ServersTestJSON-1629472790-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d93aaa7eb0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 2026.121881] env[65478]: WARNING nova.utils [None req-a131af72-b253-4cee-a0b5-8de9cb14f88c tempest-ServerGroupTestJSON-892001985 tempest-ServerGroupTestJSON-892001985-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8fc46a440> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 2038.643421] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2041.549478] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2041.549758] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2042.549151] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2042.549361] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2045.551626] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2045.551626] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2045.551626] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 2045.551626] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2046.549626] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2046.549778] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2046.549992] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2046.556877] env[65478]: WARNING nova.utils [None req-333b01a1-2411-49c3-aa82-a898f4fb0a43 tempest-AttachVolumeNegativeTest-2107378593 tempest-AttachVolumeNegativeTest-2107378593-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d920339f30> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 2047.544610] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2047.544901] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2047.549112] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2048.052173] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2048.052468] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2048.052580] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2048.052773] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 2048.053788] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f2352d0b-b781-4634-8b99-d2d859d1a15c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2048.062427] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-74b89803-f98c-4ec1-9981-64665abd89cc {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2048.076875] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6d81767e-e9f8-4172-adcb-067b7c3f2222 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2048.083874] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ae1dfe5e-9919-40e5-985c-758ce2fb8a8e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2048.112720] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=182016MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 2048.112937] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2048.113191] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2049.143615] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2049.143615] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2049.143615] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2049.143615] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2049.143615] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2049.143615] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2049.143615] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2049.143615] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2049.143615] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2049.143615] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2049.646586] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance c48fc0ab-5b1e-4147-8a37-87ad4ebca9bc has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2050.148844] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance aeffdd03-05ff-49cb-ad6f-f9247a859aae has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2050.651843] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8e8cc055-3134-46ff-ad2e-c3ab0cd1decc has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2050.652114] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 10 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 2050.652276] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2496MB phys_disk=100GB used_disk=10GB total_vcpus=48 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '10', 'num_vm_building': '10', 'num_task_deleting': '10', 'num_os_type_None': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'io_workload': '10', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 2050.797736] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9505272a-d962-42da-9e62-8bda7b1d32aa {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2050.805212] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d6ba0e31-d602-4522-a32e-2ec03f3d93d4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2050.834923] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-af15f53d-0f6b-4bc5-8417-a24ccaa0af64 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2050.841698] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-5b90aa79-e3c9-45bc-9153-32345b167cb5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2050.855012] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 2051.358937] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 2051.359399] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 2051.359566] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.246s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2051.359759] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 18.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2070.354957] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2070.861552] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 32.69 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2103.549447] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2103.549842] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2104.549461] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2104.549461] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2105.549214] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2105.549438] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2105.549490] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 2105.549721] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2106.549422] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2106.549679] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2106.549995] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Cleaning up deleted instances {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11960}}
[ 2107.053510] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] There are 1 instances to clean {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11969}}
[ 2107.053708] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] [instance: e4810749-aefd-411e-87c1-5b1b1967538f] Instance has had 0 of 5 cleanup attempts {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11973}}
[ 2107.556957] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2108.549640] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2108.549880] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2109.052384] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2110.048074] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2110.048074] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2110.550212] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2110.550603] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2110.550603] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2110.550705] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 2110.551653] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-63edef37-8770-40c1-80f8-2e40923b791b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2110.560097] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-52c01b4e-5501-42e6-875f-21de0a903564 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2110.575066] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-caea3617-ab4f-4fd7-9ed9-ad3464407dd1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2110.582058] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-afa6e890-48fa-43bb-a6b3-684f731ae2e1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2110.610645] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=182008MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 2110.610830] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2110.610969] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2111.714032] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2111.714310] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2111.714310] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2111.714390] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2111.714483] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2111.714594] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2111.714691] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2111.714812] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2111.714913] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2111.715014] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2112.218209] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance c48fc0ab-5b1e-4147-8a37-87ad4ebca9bc has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2112.722233] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance aeffdd03-05ff-49cb-ad6f-f9247a859aae has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2113.225132] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8e8cc055-3134-46ff-ad2e-c3ab0cd1decc has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2113.225380] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 10 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 2113.225514] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2496MB phys_disk=100GB used_disk=10GB total_vcpus=48 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '10', 'num_vm_building': '10', 'num_task_deleting': '10', 'num_os_type_None': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'io_workload': '10', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 2113.242547] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Refreshing inventories for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
[ 2113.255428] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Updating ProviderTree inventory for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
[ 2113.255643] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[ 2113.266034] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Refreshing aggregate associations for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5, aggregates: None {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
[ 2113.288027] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Refreshing trait associations for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_VMDK,COMPUTE_IMAGE_TYPE_ISO,HW_ARCH_X86_64,COMPUTE_SAME_HOST_COLD_MIGRATE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
[ 2113.436970] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-fa64c865-ae9e-4216-86e9-979d5a94ebf7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2113.444232] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e5636ffa-c37d-456f-9331-cd17af85edfe {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2113.475980] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-15c2eeda-3514-42df-83fd-fd8f01ff8abd {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2113.482983] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c567036b-e7a9-4e6f-80ab-16d6279b2345 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2113.496246] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 2113.999303] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 2114.000748] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 2114.000918] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.390s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2114.001056] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2114.001176] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Cleaning up deleted instances with incomplete migration  {{(pid=65478) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11998}}
[ 2114.503691] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 53.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2158.646497] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2168.005549] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2168.005947] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2168.005947] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2168.005947] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2168.006106] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2168.006143] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 2168.006295] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.54 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2170.550022] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2170.550022] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2171.544509] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2171.544785] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2171.549126] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2172.052075] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2172.052458] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2172.052458] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2172.052641] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 2172.053613] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3942e095-2b62-4ffb-be52-3a13ed5ff6dd {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2172.061671] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9832b95d-1369-4762-ada3-3976611702c9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2172.075830] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-30cc4034-6b42-48f8-9150-06be7f5cd53c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2172.082515] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4b15f76c-5d64-428c-a445-29cfabee0344 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2172.112892] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=182015MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 2172.113126] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2172.113207] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2173.141937] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2173.142259] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2173.142259] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2173.142330] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2173.142423] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2173.142477] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2173.142577] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2173.142672] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2173.142767] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2173.142863] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2173.645777] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance c48fc0ab-5b1e-4147-8a37-87ad4ebca9bc has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2174.148856] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance aeffdd03-05ff-49cb-ad6f-f9247a859aae has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2174.651701] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8e8cc055-3134-46ff-ad2e-c3ab0cd1decc has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2174.651978] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 10 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 2174.652171] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2496MB phys_disk=100GB used_disk=10GB total_vcpus=48 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '10', 'num_vm_building': '10', 'num_task_deleting': '10', 'num_os_type_None': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'io_workload': '10', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 2174.801254] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-5e62eab0-61fc-4cd9-8aae-3e4eed447794 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2174.808795] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-827ce1b6-7a97-42f6-a5ae-ba57c98520ff {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2174.838767] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-30f39ce7-25e2-46ed-a5c0-c0a2cc89cbd6 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2174.845628] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-2ccb8ca0-1fd4-4a5c-bbc4-a403cd61d6a2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2174.858565] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 2175.361763] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 2175.363096] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 2175.363265] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.250s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2175.363459] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 17.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2193.358651] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2193.864706] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 30.68 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2222.671353] env[65478]: WARNING nova.utils [None req-d488589a-829c-4eea-a04c-0a0d2dd65304 tempest-ServersTestJSON-1629472790 tempest-ServersTestJSON-1629472790-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8fc73e290> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 2224.549552] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2224.549552] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2227.549256] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2227.549659] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2228.549253] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2228.549430] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2228.549687] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2228.549687] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 2228.549825] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2231.549556] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2231.549983] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2233.544545] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2233.544959] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2233.549111] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2234.052209] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2234.052394] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2234.052514] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2234.052657] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 2234.053677] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c44ca354-e8e2-4b06-8568-f3e3ffe9a62c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2234.063900] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-944daa4a-91ee-4647-b152-4ef45af54545 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2234.078142] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6b03bf8c-7d01-48ae-bfd7-3e01e03c59f4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2234.085068] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-510c79e6-4b25-4c0d-b5f0-11a50716d31a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2234.115019] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=181990MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 2234.115209] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2234.115334] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2235.143557] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2235.143839] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2235.143839] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2235.143972] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2235.144054] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2235.144160] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2235.144262] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2235.144361] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2235.144459] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2235.144578] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2235.647660] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8e8cc055-3134-46ff-ad2e-c3ab0cd1decc has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2236.150977] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance c7f1d215-4deb-4c03-8ae9-2a55262a072a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2236.151485] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 10 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 2236.151485] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2496MB phys_disk=100GB used_disk=10GB total_vcpus=48 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '10', 'num_vm_building': '10', 'num_task_deleting': '10', 'num_os_type_None': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'io_workload': '10', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 2236.309288] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6b86cfc3-d272-411d-b6ba-6a511b9ad409 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2236.317114] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-50e7cffa-56dc-4ecf-8566-69ee2209d359 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2236.348809] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c4720a19-a64e-427c-8abd-21d03f546e95 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2236.356398] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-29563327-f196-45bd-9a5b-67421ef94865 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2236.369706] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 2236.873053] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 2236.874426] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 2236.874587] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.759s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2236.874775] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 52.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2243.745612] env[65478]: WARNING nova.utils [None req-31916784-c747-4a07-968b-3b80a4d17df9 tempest-AttachVolumeNegativeTest-2107378593 tempest-AttachVolumeNegativeTest-2107378593-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8fc73e4d0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 2278.649640] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2288.874954] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2288.875383] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.67 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2289.549259] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2289.549594] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2289.549807] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2289.549934] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2290.549386] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2290.549829] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 2290.549829] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2293.549647] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2293.550107] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2295.544492] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2295.544839] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2295.549083] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2296.052049] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2296.052287] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2296.052459] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2296.052603] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 2296.053584] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d4a37f5d-cf6e-4c1f-96eb-6cd91fdaf2a4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2296.062384] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3a149a5e-1519-40ff-ab28-f5cd80c102c7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2296.076633] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6bf2c3d4-6f32-4802-93f4-cc33bc28bfe2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2296.083265] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3caa05ce-65d7-434a-bfbd-6aebd116e625 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2296.113484] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=182006MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 2296.113649] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2296.113860] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2297.154245] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2297.154670] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2297.154670] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2297.154670] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2297.154670] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2297.154820] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2297.154864] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2297.155033] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2297.155117] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2297.155182] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2297.657887] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance c7f1d215-4deb-4c03-8ae9-2a55262a072a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2298.161069] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance f4c92475-2fb5-48c1-9aee-aa8792b12190 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2298.161554] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 10 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 2298.161554] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2496MB phys_disk=100GB used_disk=10GB total_vcpus=48 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '10', 'num_vm_building': '10', 'num_task_deleting': '10', 'num_os_type_None': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'io_workload': '10', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 2298.407770] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-feb2a0ec-727b-422a-ad98-f3ddadffe9d4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2298.414877] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1cb5f5d1-7043-40f2-937f-117496a9821c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2298.444757] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4d9284fc-f2ca-4b25-8d5d-f0d6ec80d52e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2298.451827] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3812ed93-3f36-40f0-84fd-3f86ef7c4c43 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2298.464536] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 2298.967632] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 2298.969047] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 2298.969214] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.855s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2298.969417] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 13.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2312.965111] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2313.471526] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 32.08 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2345.549393] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2345.549865] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2349.549244] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2349.549684] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2349.549684] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2351.549309] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2351.549791] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2351.549791] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 2351.549791] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2353.549827] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2353.550232] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2355.545625] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2355.545913] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2356.550063] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2357.052682] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2357.052970] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2357.053154] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2357.053293] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 2357.054271] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-17601358-8ae2-45d2-8e2d-64d2233bb25b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2357.062122] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8c67fae1-dcd3-4b2c-8c79-05bb0ca1f81a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2357.075852] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a30f46b5-2711-40d8-abf0-8f50c103dd8c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2357.082754] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-47d0f93f-24b5-4b4b-82dc-602c91e4be80 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2357.111594] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=182000MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 2357.111747] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2357.111895] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2358.137834] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2358.138104] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2358.138165] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2358.138307] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2358.138469] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2358.138618] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2358.138752] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2358.138882] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2358.139017] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2358.139152] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2358.642163] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance c7f1d215-4deb-4c03-8ae9-2a55262a072a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2359.145187] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance f4c92475-2fb5-48c1-9aee-aa8792b12190 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2359.145623] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 10 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 2359.145623] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2496MB phys_disk=100GB used_disk=10GB total_vcpus=48 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '10', 'num_vm_building': '10', 'num_task_deleting': '10', 'num_os_type_None': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'io_workload': '10', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 2359.286660] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-dc3f34e1-4fff-4a34-8ad7-497d449520b5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2359.294122] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-21f9b1c4-5b26-46d0-b870-febb4be920f8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2359.325126] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a2abca6b-4f66-422e-a4f0-45df8a764a98 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2359.332411] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8fd63765-bc38-46da-a3a9-8e42eb2903c7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2359.345791] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 2359.849104] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 2359.850525] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 2359.850701] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.739s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2359.850882] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.70 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2398.652715] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2408.549469] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2408.549894] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2409.052170] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2411.051996] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2411.052424] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Cleaning up deleted instances {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11960}}
[ 2411.555655] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] There are 0 instances to clean {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11969}}
[ 2411.555875] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2412.053207] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2412.053704] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2412.053704] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2412.549551] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2412.549758] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2413.549271] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2413.549706] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 2413.549706] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2414.549663] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2414.550143] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2415.544541] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2415.544760] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2416.549425] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2417.052683] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2417.052927] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2417.053043] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2417.053186] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 2417.054229] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-eb1c9ce7-66c0-411e-8eef-abc05ea7a4c4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2417.063028] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-69bd6989-6f1c-4fee-b654-401ca247dad5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2417.076976] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b04b6327-4ff2-44ed-baab-fba39a0c799f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2417.084055] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-209d8707-62a8-4215-86d0-ff739336bd25 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2417.114481] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=182013MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 2417.114683] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2417.114778] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2418.178515] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2418.178941] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2418.178941] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2418.178941] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2418.178941] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2418.179252] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2418.179252] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2418.179252] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2418.179426] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2418.179426] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2418.682929] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance f4c92475-2fb5-48c1-9aee-aa8792b12190 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2418.683315] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 10 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 2418.683576] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2496MB phys_disk=100GB used_disk=10GB total_vcpus=48 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '10', 'num_vm_building': '10', 'num_task_deleting': '10', 'num_os_type_None': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'io_workload': '10', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 2418.704892] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Refreshing inventories for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
[ 2418.718381] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Updating ProviderTree inventory for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
[ 2418.718549] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[ 2418.731437] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Refreshing aggregate associations for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5, aggregates: None {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
[ 2418.746977] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Refreshing trait associations for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_VMDK,COMPUTE_IMAGE_TYPE_ISO,HW_ARCH_X86_64,COMPUTE_SAME_HOST_COLD_MIGRATE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
[ 2418.869758] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d4ce68a8-4f66-4512-b980-db66b46beb8f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2418.876936] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9326eaa4-c51d-45a7-aa9e-78a3e45c8e4a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2418.907582] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-31b7b566-1b67-4231-8e3e-8d11d500a197 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2418.914790] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-dd99a22a-e160-4f23-b8fe-50c3ae0feb93 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2418.927539] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 2419.212588] env[65478]: WARNING nova.utils [None req-d0e15377-1aea-4c91-80d6-09c6de04163e tempest-ServersTestJSON-1629472790 tempest-ServersTestJSON-1629472790-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d93aaf35b0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 2419.430682] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 2419.431966] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 2419.432163] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.317s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2419.432349] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2419.432474] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Cleaning up deleted instances with incomplete migration  {{(pid=65478) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11998}}
[ 2419.934977] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 17.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2437.930189] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2438.436868] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.85 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2441.100595] env[65478]: WARNING nova.utils [None req-99f0ca51-c8af-45a3-9d81-761ea46c5bac tempest-AttachVolumeNegativeTest-2107378593 tempest-AttachVolumeNegativeTest-2107378593-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d920339b40> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 2445.288147] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2445.288710] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Getting list of instances from cluster (obj){
[ 2445.288710] env[65478]:    value = "domain-c8"
[ 2445.288710] env[65478]:    _type = "ClusterComputeResource"
[ 2445.288710] env[65478]:  } {{(pid=65478) list_instances /opt/stack/nova/nova/virt/vmwareapi/vmops.py:2116}}
[ 2445.290072] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ba57cea3-4695-41d0-a0dd-cc98274020ed {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2445.299555] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Got total of 0 instances {{(pid=65478) list_instances /opt/stack/nova/nova/virt/vmwareapi/vmops.py:2125}}
[ 2445.299817] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 23.26 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2468.561567] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2468.561991] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2472.549928] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2472.549928] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.56 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2473.109069] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._sync_power_states {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2473.614029] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Getting list of instances from cluster (obj){
[ 2473.614029] env[65478]:    value = "domain-c8"
[ 2473.614029] env[65478]:    _type = "ClusterComputeResource"
[ 2473.614029] env[65478]:  } {{(pid=65478) list_instances /opt/stack/nova/nova/virt/vmwareapi/vmops.py:2116}}
[ 2473.616033] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3718239d-0e30-410a-9cb9-b047f13d6e24 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2473.623826] env[65478]: DEBUG nova.virt.vmwareapi.vmops [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Got total of 0 instances {{(pid=65478) list_instances /opt/stack/nova/nova/virt/vmwareapi/vmops.py:2125}}
[ 2473.623971] env[65478]: WARNING nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] While synchronizing instance power states, found 10 instances in the database and 0 instances on the hypervisor.
[ 2473.624120] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Sync already in progress for 77a0e8c4-b77a-45b9-a249-d98866d4048a {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11069}}
[ 2473.624267] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Sync already in progress for 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11069}}
[ 2473.624348] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Sync already in progress for d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11069}}
[ 2473.624462] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Sync already in progress for 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11069}}
[ 2473.624601] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Sync already in progress for d4d3cf75-1781-46ed-afb2-44e6f2c048e2 {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11069}}
[ 2473.624732] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Sync already in progress for ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11069}}
[ 2473.624841] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Sync already in progress for 25ec70f9-947b-4ebe-82df-1a1ddcc59360 {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11069}}
[ 2473.624950] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Sync already in progress for 8d032b6f-86df-4397-8727-d4336f973368 {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11069}}
[ 2473.625068] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Sync already in progress for e2e07720-a241-4382-a684-0835b199e37d {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11069}}
[ 2473.625173] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Sync already in progress for 28d4751c-5d09-422a-84b1-e82df32f6b4d {{(pid=65478) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11069}}
[ 2473.625359] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.44 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2474.065682] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2474.065911] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2474.066026] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.48 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2474.549290] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2474.549509] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2474.549551] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 2474.549795] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2476.544902] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2476.545331] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2476.549123] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2477.052309] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2477.052526] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2477.052651] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2477.052795] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 2477.053729] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f1ad999a-e308-4d48-825f-311d98f8d4b3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2477.062191] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-206a84d2-e4db-4c2d-a405-50723cfc0ec5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2477.076974] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0e1c0809-bb27-44d0-a05a-bd397e6ae76d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2477.083379] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-cdd09554-fd19-4264-a6ff-d71889bcd842 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2477.113786] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=182008MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 2477.113943] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2477.114073] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2478.141873] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2478.142169] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2478.142169] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2478.142252] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2478.142340] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2478.142440] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2478.142540] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2478.142637] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2478.142735] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2478.142831] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2478.645810] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance c952ac3f-e2b8-4420-b9a7-a68c89432f22 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2479.148833] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance fb7c7976-2600-4615-bf28-9c15c83d2413 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2479.149285] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 10 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 2479.149285] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2496MB phys_disk=100GB used_disk=10GB total_vcpus=48 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '10', 'num_vm_building': '10', 'num_task_deleting': '10', 'num_os_type_None': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'io_workload': '10', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 2479.302411] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a214a430-8dc6-4a37-9ef9-ac758b677670 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2479.309590] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9e9d923b-7c2f-43c1-a36a-5505cb6fbbbf {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2479.341188] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-2d3396e6-d240-4e56-b1d8-c26b49997266 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2479.348956] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-716031e4-0d97-4bd8-91dd-8c726c6a4d35 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2479.367015] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 2479.870655] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 2479.872018] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 2479.872188] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.758s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2479.872382] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 52.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2518.655705] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2531.872428] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2531.873173] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.68 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2532.550115] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2532.550351] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2534.549220] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2534.549549] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2534.549549] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2534.549624] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2535.549544] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2535.549544] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 2535.549544] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2536.549271] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2537.052467] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2537.052902] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2537.052902] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2537.053040] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 2537.053959] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-79e9a0a7-3800-4dbd-acc4-021d600bac25 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2537.061759] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a61412f9-c34b-4ab2-9936-4f301a1ce533 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2537.076647] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-a8cecf2c-d709-4e1b-ac02-3b9febff6751 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2537.083402] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4dba87a5-1a6c-4b53-ae88-14dd8c959df7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2537.112536] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=181998MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 2537.112715] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2537.112819] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2538.143089] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2538.143398] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2538.143398] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2538.143515] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2538.143564] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2538.143625] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2538.143722] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2538.143841] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2538.144271] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2538.144373] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2538.647332] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance c952ac3f-e2b8-4420-b9a7-a68c89432f22 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2539.150503] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance fb7c7976-2600-4615-bf28-9c15c83d2413 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2539.150949] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 10 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 2539.151053] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2496MB phys_disk=100GB used_disk=10GB total_vcpus=48 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '10', 'num_vm_building': '10', 'num_task_deleting': '10', 'num_os_type_None': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'io_workload': '10', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 2539.298036] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3ae5d70a-a959-4ef3-b30b-7eba0b39960e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2539.305976] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-68fa3f65-692a-448b-9fc8-69a2b0017093 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2539.337776] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e795570c-761a-46b4-a5cd-f2fd63eddcf1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2539.345025] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-144db81f-b591-47f3-96f4-bffa6549c16c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2539.358023] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 2539.863027] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 2539.863027] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 2539.865973] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.750s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2539.867119] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2541.865826] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2541.866440] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 16.68 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2558.544480] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2559.050544] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 31.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2590.549328] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2590.549751] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2592.549566] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2592.550026] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2594.549225] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2594.549691] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2594.549691] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2595.549229] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2595.549650] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2595.549650] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 2595.549650] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2596.549303] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2597.052555] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2597.052790] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2597.052946] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2597.053045] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 2597.054024] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-83cd9d2c-6ee3-481d-984f-fc640d2aafe1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2597.062260] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9a915be3-1e6e-4fbf-8a5a-970f50b4e832 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2597.076105] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-272d9cc9-2516-4c2f-81dc-b18cbbd832bf {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2597.082565] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-fff7e96d-bd91-4f71-af07-36442bb1630d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2597.112310] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=182010MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 2597.112483] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2597.112653] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2598.138437] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2598.138712] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2598.138712] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2598.138793] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2598.138869] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2598.138969] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2598.139083] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2598.139184] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2598.139283] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2598.139377] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2598.642283] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance c952ac3f-e2b8-4420-b9a7-a68c89432f22 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2599.145382] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance fb7c7976-2600-4615-bf28-9c15c83d2413 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2599.145821] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 10 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 2599.145821] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2496MB phys_disk=100GB used_disk=10GB total_vcpus=48 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '10', 'num_vm_building': '10', 'num_task_deleting': '10', 'num_os_type_None': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'io_workload': '10', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 2599.279882] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e619a50d-30f5-4a97-95d8-c1cb5032bcc8 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2599.287046] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f470696c-b213-4f88-af08-7792a1144d5d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2599.317400] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b4f292b1-c573-445c-8f73-1043acb121bf {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2599.324628] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-737c9996-5cf3-4364-bde9-f0ff24c06f3e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2599.337443] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 2599.840503] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 2599.841826] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 2599.841989] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.729s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2599.842214] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2601.837575] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2601.837575] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.71 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2616.473103] env[65478]: WARNING nova.utils [None req-50cfd060-d8a5-493b-ac8e-5296ea45bf7a tempest-ServersTestJSON-1629472790 tempest-ServersTestJSON-1629472790-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d8fc73e050> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 2638.658684] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2650.549152] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2650.549486] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2654.549484] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2654.549779] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2655.549278] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2655.549453] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 2655.549611] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2656.549316] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2656.549473] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2656.549632] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2657.053081] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2657.053353] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2657.053479] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2657.053622] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 2657.054624] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9d94a83a-66fd-406e-a9ee-ee26636373eb {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2657.064868] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-02c3b4cd-46a2-45a5-9caf-4be121c53da0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2657.078618] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3262dea7-83bc-4188-b69e-8cdc674bfb47 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2657.086026] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9fccffe8-6f78-4f76-bac2-b55f65338866 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2657.115307] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=182017MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 2657.115687] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2657.115982] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2658.147152] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2658.147481] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2658.147481] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2658.147481] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2658.147593] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2658.147692] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2658.147782] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2658.147883] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2658.147983] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2658.148102] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2658.651061] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ddea4074-3581-4bb7-a447-d37b091d07f8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2658.651377] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 10 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 2658.651443] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2496MB phys_disk=100GB used_disk=10GB total_vcpus=48 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '10', 'num_vm_building': '10', 'num_task_deleting': '10', 'num_os_type_None': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'io_workload': '10', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 2658.786538] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-44532171-d498-42ff-845c-51f03ba6f33d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2658.793810] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0278f223-73a5-4687-9387-e85b73833d1a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2658.825052] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-8787adbd-d0c2-457b-a6df-63cbaadd32a0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2658.832164] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-24533a3b-920b-419d-9412-36b3bfa41f60 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2658.845675] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 2659.349128] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 2659.350511] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 2659.350776] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.235s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2659.351145] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2660.350654] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2660.350936] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2660.351040] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 19.19 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2679.545064] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2680.051054] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 30.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2710.549329] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2710.549816] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2715.549504] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2715.549942] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2716.052371] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2717.051883] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2717.052253] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 2717.052253] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2717.549674] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2717.549910] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2718.549241] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2718.549620] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2719.052599] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2719.052828] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2719.052979] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2719.053125] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 2719.054288] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-cfc4ef72-1e06-461b-969f-8b829a1cd38a {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2719.062387] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-7147682d-de1b-4883-a617-a26ca0cf92c0 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2719.076379] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-84bae353-36c2-481f-a0fc-9d2e5e18d170 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2719.082958] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-9281f8d8-9386-4f47-84ec-41f69550222e {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2719.112666] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=182025MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 2719.112830] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2719.112959] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2720.270389] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2720.270693] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2720.270693] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2720.270781] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2720.270820] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2720.270914] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2720.271099] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2720.271213] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2720.271310] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2720.271405] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2720.774398] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ddea4074-3581-4bb7-a447-d37b091d07f8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2720.774624] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 10 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 2720.774776] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2496MB phys_disk=100GB used_disk=10GB total_vcpus=48 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '10', 'num_vm_building': '10', 'num_task_deleting': '10', 'num_os_type_None': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'io_workload': '10', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 2720.791483] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Refreshing inventories for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
[ 2720.803908] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Updating ProviderTree inventory for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
[ 2720.804083] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Updating inventory in ProviderTree for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 with inventory: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
[ 2720.814444] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Refreshing aggregate associations for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5, aggregates: None {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
[ 2720.831335] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Refreshing trait associations for resource provider e3a5020e-0218-494b-ae38-8b55aa77f6f5, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_VMDK,COMPUTE_IMAGE_TYPE_ISO,HW_ARCH_X86_64,COMPUTE_SAME_HOST_COLD_MIGRATE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=65478) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
[ 2720.948252] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-575dee86-1ef7-4d92-aa4c-f1e210ef5f66 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2720.955413] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-d8a6299d-32cb-4cf3-9bf4-444369742bef {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2720.985772] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-fe893ade-9797-41bd-a42b-bb5a7e1b3e29 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2720.992830] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-b6dcac93-0bba-4905-a766-37d03e6d7e1f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2721.005860] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 2721.508987] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 2721.510346] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 2721.510502] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.398s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2721.510656] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2721.510783] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Cleaning up deleted instances {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11960}}
[ 2722.013592] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] There are 0 instances to clean {{(pid=65478) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11969}}
[ 2722.013831] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2722.014062] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Cleaning up deleted instances with incomplete migration  {{(pid=65478) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11998}}
[ 2722.516714] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2723.516546] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2723.516774] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2723.517060] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.03 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2758.661710] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2770.549315] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2770.549756] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2776.549506] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2776.549831] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2777.549669] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2777.549669] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 2777.549669] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2778.549887] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2778.549887] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2779.550079] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2779.550079] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2780.052514] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2780.052735] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2780.052888] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2780.053023] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 2780.053977] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-e8db5e60-5383-4afb-ac44-04ee8479e730 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2780.063326] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-93253172-1a8e-475a-a8bf-7fb2a50add44 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2780.076857] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-cd9b3857-dc4d-427d-868a-e5d1c7e217db {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2780.083380] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-7ddf2d20-3146-4b2e-bac1-78e0ca0c48e5 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2780.112464] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=182017MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 2780.112657] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2780.112744] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2781.138043] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2781.138353] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2781.138353] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2781.138353] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2781.138569] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2781.138569] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2781.138569] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2781.138740] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2781.138778] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2781.138843] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2781.641730] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ddea4074-3581-4bb7-a447-d37b091d07f8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2781.641978] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 10 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 2781.642171] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2496MB phys_disk=100GB used_disk=10GB total_vcpus=48 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '10', 'num_vm_building': '10', 'num_task_deleting': '10', 'num_os_type_None': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'io_workload': '10', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 2781.761595] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f78ddf64-e475-4d30-8796-5ddfa486cae3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2781.768854] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1ba2c004-114c-4c71-85b1-475e89b09acf {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2781.800257] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-bb7d02ab-0e07-4cc4-84f5-bcd9b0a12f06 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2781.807194] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-617c8825-a2ca-4ad1-bb69-7f71d4e3944f {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2781.820091] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 2782.323211] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 2782.324645] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 2782.324808] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.212s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2782.325011] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2784.324886] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2784.325346] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2784.325346] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 20.22 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2804.544421] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2805.053439] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 25.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2812.713615] env[65478]: WARNING nova.utils [None req-cf3250b0-ee07-467e-ba7c-84d3c24ab7a0 tempest-ServersTestJSON-1629472790 tempest-ServersTestJSON-1629472790-project-member] The MainProcess.default pool does not have free threads so the task <function ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance at 0x73d9202e6950> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
[ 2830.549721] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2830.549721] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2836.549527] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2836.549965] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2837.549348] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2837.549602] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 2837.549911] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2838.549819] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2838.550103] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2840.549426] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2840.549426] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2841.550078] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2842.052484] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2842.052744] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2842.052868] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2842.053024] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 2842.054030] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6a0dc11d-7299-4b1d-bbb5-74ea1b9caa7c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2842.062726] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-eff8351f-508b-4bf1-a11b-bf617a840bab {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2842.076412] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-730e9e3d-d1f8-4848-be03-5c76f27583ac {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2842.082911] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-369a1d7a-4034-4ef0-9b92-8660311d9912 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2842.112546] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=182008MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 2842.112708] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2842.112848] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2843.144501] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2843.144816] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2843.144816] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2843.144953] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2843.145011] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2843.145125] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2843.145535] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2843.145640] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2843.145739] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2843.145838] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2843.648775] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8cc587ac-1348-4278-a79b-41db9dd7e34b has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2843.649079] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 10 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 2843.649181] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2496MB phys_disk=100GB used_disk=10GB total_vcpus=48 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '10', 'num_vm_building': '10', 'num_task_deleting': '10', 'num_os_type_None': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'io_workload': '10', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 2843.813464] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1023913d-efe4-425a-ba0a-451dfd5b5d4b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2843.821523] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c14d4b74-5c00-487b-be7b-d650469dfbe4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2843.854348] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f24f0bfc-140e-41d4-9d1c-9e86e92419cc {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2843.862407] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-6ea14b65-74f3-4a9f-9f1f-0b14a38899f1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2843.876602] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 2844.379897] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 2844.381233] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 2844.381396] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.269s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2844.381596] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2846.376668] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2846.377122] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2846.377122] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.17 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2878.665099] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2892.549367] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2892.549863] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2897.549577] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2897.550080] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2898.549209] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2898.549452] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2899.549512] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2899.549512] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 2899.550058] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2900.550060] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2900.550060] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2903.550020] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2903.550020] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2904.053183] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2904.053635] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2904.053915] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2904.054198] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 2904.055290] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-219d38d0-ee05-4044-a0d2-fe25c7efc035 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2904.064066] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-52ff3a5a-6762-4cd2-aeb8-6b7a651704f3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2904.078937] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-0f4eadfa-2c9c-40ef-b0aa-79fc2ef15761 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2904.086090] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-7eaa386f-aa51-4ed9-904c-f9121adee4d4 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2904.115950] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=182004MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 2904.116394] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2904.117052] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2905.144239] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2905.144526] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2905.144526] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2905.144599] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2905.144686] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2905.144783] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2905.144878] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2905.144973] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2905.145093] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2905.145170] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2905.648147] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8cc587ac-1348-4278-a79b-41db9dd7e34b has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2905.648398] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 10 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 2905.648539] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2496MB phys_disk=100GB used_disk=10GB total_vcpus=48 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '10', 'num_vm_building': '10', 'num_task_deleting': '10', 'num_os_type_None': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'io_workload': '10', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 2905.774990] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-415501c4-e14e-44d7-9a61-284d74e3cdf2 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2905.782171] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-adb0427e-9a7b-472f-8c70-4107e01a2d6c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2905.814429] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-17878d13-deb3-4518-9ea6-8eae8e5caeba {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2905.821788] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-c9008a90-6a5d-4109-bc70-3b505fc36d21 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2905.835081] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 2906.338402] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 2906.339736] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 2906.339901] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.223s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2906.340173] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2908.335195] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2908.336077] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 18.21 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2926.544687] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2927.050889] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 25.50 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2952.549533] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2952.549533] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 7.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2959.549545] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2959.549981] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2960.549835] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2960.549835] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2960.549835] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2960.549835] env[65478]: DEBUG nova.compute.manager [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=65478) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}}
[ 2960.549835] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2963.550132] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2963.550132] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager.update_available_resource {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2964.052665] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2964.053203] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2964.053502] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2964.053765] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Auditing locally available compute resources for cpu-1 (node: domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) {{(pid=65478) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
[ 2964.055052] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-71533694-ffdc-40d0-a678-3ce48f952ca1 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2964.062797] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-1a292de9-fc0b-440f-bb8d-873e29bb56c3 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2964.077312] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-4d02f2f4-1050-456b-99b6-bea155411bf7 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2964.085033] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-80cc0a71-7dca-4a20-acc1-63b8303f6670 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2964.114701] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Hypervisor/Node resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 free_ram=182006MB free_disk=94GB free_vcpus=48 pci_devices=None {{(pid=65478) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
[ 2964.116104] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2964.116104] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2965.147023] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 77a0e8c4-b77a-45b9-a249-d98866d4048a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2965.147023] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 30e11bc9-0bfa-4cbf-bd02-f8262e343b79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2965.147023] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d9d5bc08-ca4b-4029-8bc6-c6795f3cc2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2965.147023] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 00b6d30d-5de3-4c87-8af4-0fe6d88eb906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2965.147023] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance d4d3cf75-1781-46ed-afb2-44e6f2c048e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2965.147023] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance ec1a8c79-d97b-4eb0-b024-1b0c86ccab17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2965.147023] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 25ec70f9-947b-4ebe-82df-1a1ddcc59360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2965.147023] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8d032b6f-86df-4397-8727-d4336f973368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2965.147023] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance e2e07720-a241-4382-a684-0835b199e37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2965.147023] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 28d4751c-5d09-422a-84b1-e82df32f6b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
[ 2965.649861] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Instance 8cc587ac-1348-4278-a79b-41db9dd7e34b has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=65478) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
[ 2965.651051] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Total usable vcpus: 48, total allocated vcpus: 10 {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
[ 2965.651051] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Final resource view: name=domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 phys_ram=196590MB used_ram=2496MB phys_disk=100GB used_disk=10GB total_vcpus=48 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'num_instances': '10', 'num_vm_building': '10', 'num_task_deleting': '10', 'num_os_type_None': '10', 'num_proj_72b592b2cc8847f8b7a39f4deaaddf00': '1', 'io_workload': '10', 'num_proj_0d8c4a555eaa458ea33089c2385346b7': '1', 'num_proj_559841402a03481fa2bd3e1ed3695057': '3', 'num_proj_76d81f80d884476a8abfeced41e5668f': '1', 'num_proj_88b6f91cedac41a6aeb3e367dace092b': '1', 'num_proj_4b5f999434204668902d55d3ca25042a': '2', 'num_proj_2f996160d4314ba2b52bcc9b7f898929': '1'} {{(pid=65478) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
[ 2965.770467] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-7c28ec83-e4af-47f9-8037-bc37019bd35c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2965.781601] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-ad035f13-cd0d-46ae-8112-62b0d8040123 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2965.812971] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-f2b5289d-5fa7-4dd3-bce9-0e845bd84d12 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2965.820240] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-41713299-69e4-49ca-8917-a2167917ab26 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2965.833424] env[65478]: DEBUG nova.compute.provider_tree [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed in ProviderTree for provider: e3a5020e-0218-494b-ae38-8b55aa77f6f5 {{(pid=65478) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
[ 2966.336596] env[65478]: DEBUG nova.scheduler.client.report [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Inventory has not changed for provider e3a5020e-0218-494b-ae38-8b55aa77f6f5 based on inventory data: {'VCPU': {'total': 48, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 196590, 'reserved': 512, 'min_unit': 1, 'max_unit': 65530, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 200, 'reserved': 0, 'min_unit': 1, 'max_unit': 94, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=65478) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
[ 2966.337918] env[65478]: DEBUG nova.compute.resource_tracker [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Compute_service record updated for cpu-1:domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28 {{(pid=65478) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
[ 2966.338580] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.223s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2966.338580] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2968.333482] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2968.333867] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 13.22 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
[ 2981.549700] env[65478]: DEBUG oslo_service.periodic_task [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=65478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
[ 2981.550239] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2981.550863] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2981.551281] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2981.551505] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
[ 2981.551860] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
[ 2981.552227] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=65478) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
[ 2982.058257] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-3c831232-9ce2-40ac-82e8-bf394898637d {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2982.066486] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking PropertyCollector.RetrievePropertiesEx with opID=oslo.vmware-421571fe-6615-421e-a681-586f4ba6169c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2982.584239] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-5bda5bfa-a7a8-4b00-8d0a-f957769f4b50 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2982.589792] env[65478]: DEBUG oslo_vmware.api [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Waiting for the task: (returnval){
[ 2982.589792] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52dcb1a2-09f8-328c-d83c-6e71de7b2d3c"
[ 2982.589792] env[65478]:    _type = "Task"
[ 2982.589792] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 2982.597446] env[65478]: DEBUG oslo_vmware.api [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52dcb1a2-09f8-328c-d83c-6e71de7b2d3c, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 2983.101200] env[65478]: DEBUG oslo_vmware.api [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52dcb1a2-09f8-328c-d83c-6e71de7b2d3c, 'name': SearchDatastore_Task, 'duration_secs': 0.008688} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 2983.101553] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "[datastore1] devstack-image-cache_base/" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[ 2983.101663] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquired lock "[datastore1] devstack-image-cache_base/" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[ 2983.102119] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquired external semaphore "[datastore1] devstack-image-cache_base/" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[ 2983.102268] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-d27e9290-d6dc-449b-a849-96e26520198c {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2983.106583] env[65478]: DEBUG oslo_vmware.api [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Waiting for the task: (returnval){
[ 2983.106583] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52d4dafb-3e21-87ca-5a35-0b9db065bcb8"
[ 2983.106583] env[65478]:    _type = "Task"
[ 2983.106583] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 2983.113775] env[65478]: DEBUG oslo_vmware.api [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52d4dafb-3e21-87ca-5a35-0b9db065bcb8, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 2983.616640] env[65478]: DEBUG oslo_vmware.api [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52d4dafb-3e21-87ca-5a35-0b9db065bcb8, 'name': SearchDatastore_Task, 'duration_secs': 0.007707} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 2983.617134] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Releasing lock "[datastore1] devstack-image-cache_base/" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[ 2983.617134] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[ 2983.617227] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquired lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[ 2983.617456] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquired external semaphore "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[ 2983.617715] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-e0f95db0-24a7-4e6c-9927-c036f69ef9a9 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2983.622158] env[65478]: DEBUG oslo_vmware.api [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Waiting for the task: (returnval){
[ 2983.622158] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]523d7618-3630-e2c4-15a1-4ca072911980"
[ 2983.622158] env[65478]:    _type = "Task"
[ 2983.622158] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 2983.630139] env[65478]: DEBUG oslo_vmware.api [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]523d7618-3630-e2c4-15a1-4ca072911980, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 2984.132781] env[65478]: DEBUG oslo_vmware.api [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]523d7618-3630-e2c4-15a1-4ca072911980, 'name': SearchDatastore_Task, 'duration_secs': 0.010086} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 2984.133094] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Releasing lock "[datastore1] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[ 2984.133338] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-4cdb4e91-2f14-4302-85b3-421cd1ff3f96 {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2984.138014] env[65478]: DEBUG oslo_vmware.api [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Waiting for the task: (returnval){
[ 2984.138014] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]529af415-71a6-2f32-4a5a-af0361e3b338"
[ 2984.138014] env[65478]:    _type = "Task"
[ 2984.138014] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 2984.145751] env[65478]: DEBUG oslo_vmware.api [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]529af415-71a6-2f32-4a5a-af0361e3b338, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 2984.647733] env[65478]: DEBUG oslo_vmware.api [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]529af415-71a6-2f32-4a5a-af0361e3b338, 'name': SearchDatastore_Task, 'duration_secs': 0.007203} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 2984.648162] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "[datastore2] devstack-image-cache_base/" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[ 2984.648215] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquired lock "[datastore2] devstack-image-cache_base/" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[ 2984.648519] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquired external semaphore "[datastore2] devstack-image-cache_base/" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[ 2984.648767] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-d164cbba-da85-44bd-87da-820eae343dba {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2984.653473] env[65478]: DEBUG oslo_vmware.api [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Waiting for the task: (returnval){
[ 2984.653473] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]52f09a33-cc30-5383-51b4-76cfe811f579"
[ 2984.653473] env[65478]:    _type = "Task"
[ 2984.653473] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 2984.660975] env[65478]: DEBUG oslo_vmware.api [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52f09a33-cc30-5383-51b4-76cfe811f579, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 2985.163384] env[65478]: DEBUG oslo_vmware.api [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]52f09a33-cc30-5383-51b4-76cfe811f579, 'name': SearchDatastore_Task, 'duration_secs': 0.006154} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 2985.163586] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Releasing lock "[datastore2] devstack-image-cache_base/" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[ 2985.163743] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquiring lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
[ 2985.163847] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquired lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
[ 2985.164159] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Acquired external semaphore "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:401}}
[ 2985.164427] env[65478]: DEBUG oslo_vmware.service [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Invoking HostDatastoreBrowser.SearchDatastore_Task with opID=oslo.vmware-26a9ce99-b837-4192-98ca-4e1cbee6d99b {{(pid=65478) request_handler /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/service.py:371}}
[ 2985.168514] env[65478]: DEBUG oslo_vmware.api [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Waiting for the task: (returnval){
[ 2985.168514] env[65478]:    value = "session[528bb04f-73c4-f368-7048-57ab7d5c808d]5247a389-13de-dd76-e541-35cdcb84f739"
[ 2985.168514] env[65478]:    _type = "Task"
[ 2985.168514] env[65478]:  } to complete. {{(pid=65478) wait_for_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:397}}
[ 2985.175958] env[65478]: DEBUG oslo_vmware.api [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5247a389-13de-dd76-e541-35cdcb84f739, 'name': SearchDatastore_Task} progress is 0%. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:434}}
[ 2985.679527] env[65478]: DEBUG oslo_vmware.api [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Task: {'id': session[528bb04f-73c4-f368-7048-57ab7d5c808d]5247a389-13de-dd76-e541-35cdcb84f739, 'name': SearchDatastore_Task, 'duration_secs': 0.011562} completed successfully. {{(pid=65478) _poll_task /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/api.py:444}}
[ 2985.679908] env[65478]: DEBUG oslo_concurrency.lockutils [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Releasing lock "[datastore2] devstack-image-cache_base/901a05bf-ca6f-4e54-a6ec-7c357eec1043" {{(pid=65478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
[ 2985.679965] env[65478]: DEBUG oslo.service.backend._threading.loopingcall [None req-54006a53-d218-4ad4-8af1-c4e2fa34e5bc None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 31.00 seconds {{(pid=65478) _run_loop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}